Jul 21 17:24:04.879541 ip-10-0-139-6 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 21 17:24:04.879553 ip-10-0-139-6 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 21 17:24:04.879560 ip-10-0-139-6 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 21 17:24:04.879839 ip-10-0-139-6 systemd[1]: Failed to start Kubernetes Kubelet. Jul 21 17:24:15.128893 ip-10-0-139-6 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 21 17:24:15.128909 ip-10-0-139-6 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6d9922d2e40d4e9c9891ba56c26102f3 -- Jul 21 17:26:15.677889 ip-10-0-139-6 systemd[1]: Starting Kubernetes Kubelet... Jul 21 17:26:16.084583 ip-10-0-139-6 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 17:26:16.084583 ip-10-0-139-6 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 17:26:16.084583 ip-10-0-139-6 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 17:26:16.084583 ip-10-0-139-6 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 17:26:16.084583 ip-10-0-139-6 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 17:26:16.085386 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.084603 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 17:26:16.089187 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089165 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:26:16.089187 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089183 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:26:16.089187 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089187 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:26:16.089187 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089192 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:26:16.089187 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089196 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089201 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089210 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089214 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089218 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089221 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089224 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089228 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089232 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089236 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089239 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089243 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089247 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089252 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089256 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089259 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089264 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089268 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089272 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089276 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:26:16.089482 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089280 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089283 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089287 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089291 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089295 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089299 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089302 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089306 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089310 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089314 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089318 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089323 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089326 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089331 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089336 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089342 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089346 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089350 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089357 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089362 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:26:16.090329 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089366 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089371 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089375 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089379 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089384 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089388 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089392 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089396 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089400 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089404 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089408 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089413 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089417 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089421 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089425 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089432 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089438 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089443 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089448 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089452 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:26:16.091085 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089457 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089464 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089473 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089478 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089483 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089487 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089492 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089497 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089502 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089506 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089511 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089515 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089519 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089523 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089527 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089532 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089536 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089540 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089545 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:26:16.091939 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089549 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089572 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089576 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089581 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089585 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089589 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089593 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089597 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089601 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089606 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089610 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089614 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089618 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089621 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089626 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.089632 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091433 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091452 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091459 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:26:16.092535 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091465 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091472 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091477 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091483 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091493 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091498 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091502 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091506 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091511 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091515 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091520 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091524 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091528 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091532 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091537 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091541 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091546 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091574 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091580 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:26:16.093162 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091584 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091588 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091593 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091597 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091601 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091605 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091610 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091614 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091618 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091622 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091631 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091635 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091640 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091645 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091649 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091654 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091658 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091664 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091669 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091673 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:26:16.093659 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091678 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091682 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091686 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091695 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091699 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091704 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091708 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091713 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091719 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091726 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091731 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091738 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091742 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091747 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091757 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091761 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091765 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091770 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091774 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091779 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:26:16.094150 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091783 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091788 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091792 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091797 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091801 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091809 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091815 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091825 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091830 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091835 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091841 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091849 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091853 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091858 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091863 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091868 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091872 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091877 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091886 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:26:16.094661 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091891 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091895 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091899 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091906 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091911 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091916 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091920 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091925 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091929 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.091979 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092117 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092122 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092126 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092129 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092134 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092137 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092139 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092142 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092548 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092570 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:26:16.095137 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092574 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092577 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092580 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092583 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092586 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092588 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092591 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092594 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092597 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092599 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092602 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092604 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092607 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092610 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092613 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092616 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092620 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092624 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092627 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:26:16.095652 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092630 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092633 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092636 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092639 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092643 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092647 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092650 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092653 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092655 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092658 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092661 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092663 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092667 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092669 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092672 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092675 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092678 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092680 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092683 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:26:16.096117 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092685 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092688 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092690 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092693 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092695 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092698 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092700 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092702 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092705 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092707 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092710 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092712 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092715 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092717 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092720 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092723 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092725 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092728 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092730 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092733 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:26:16.096592 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092735 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092738 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092740 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092743 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092745 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092747 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092750 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092752 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092755 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092757 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092762 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092765 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092777 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092780 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092782 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092785 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092788 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092790 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092793 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:26:16.097083 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092796 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092798 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092800 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092804 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092807 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092809 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092812 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092816 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092818 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092821 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092823 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092826 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092828 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092830 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092834 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092837 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092840 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092843 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092845 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.092848 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:26:16.097548 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092920 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092928 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092935 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092941 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092945 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092949 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092953 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092957 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092960 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092963 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092966 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092969 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092972 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092975 2562 flags.go:64] FLAG: --cgroup-root="" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092977 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092980 2562 flags.go:64] FLAG: --client-ca-file="" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092983 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092986 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092991 2562 flags.go:64] FLAG: --cluster-domain="" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092995 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.092998 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093001 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093004 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093008 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 17:26:16.098091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093011 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093014 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093017 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093020 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093023 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093026 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093029 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093031 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093035 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093039 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093042 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093045 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093048 2562 flags.go:64] FLAG: --enable-server="true" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093051 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093055 2562 flags.go:64] FLAG: --event-burst="100" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093058 2562 flags.go:64] FLAG: --event-qps="50" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093061 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093064 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093066 2562 flags.go:64] FLAG: --eviction-hard="" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093070 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093072 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093075 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093078 2562 flags.go:64] FLAG: --eviction-soft="" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093081 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093084 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 17:26:16.098693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093088 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093090 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093094 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093097 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093100 2562 flags.go:64] FLAG: --feature-gates="" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093103 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093106 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093109 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093112 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093115 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093118 2562 flags.go:64] FLAG: --help="false" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093120 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093123 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093126 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093129 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093132 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093135 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093138 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093142 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093145 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093148 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093151 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093154 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093156 2562 flags.go:64] FLAG: --kube-reserved="" Jul 21 17:26:16.099315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093159 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093162 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093165 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093168 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093171 2562 flags.go:64] FLAG: --lock-file="" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093174 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093177 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093180 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093185 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093189 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093192 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093195 2562 flags.go:64] FLAG: --logging-format="text" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093198 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093201 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093204 2562 flags.go:64] FLAG: --manifest-url="" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093207 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093211 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093213 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093217 2562 flags.go:64] FLAG: --max-pods="110" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093220 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093223 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093226 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093228 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093232 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093235 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 17:26:16.099918 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093238 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093245 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093248 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093251 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093254 2562 flags.go:64] FLAG: --pod-cidr="" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093257 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093263 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093265 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093268 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093271 2562 flags.go:64] FLAG: --port="10250" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093274 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093277 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-031d33e7e25446c46" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093280 2562 flags.go:64] FLAG: --qos-reserved="" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093283 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093286 2562 flags.go:64] FLAG: --register-node="true" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093289 2562 flags.go:64] FLAG: --register-with-taints="" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093292 2562 flags.go:64] FLAG: --registry-burst="10" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093296 2562 flags.go:64] FLAG: --registry-qps="5" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093298 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093301 2562 flags.go:64] FLAG: --reserved-memory="" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093305 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093308 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093311 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093313 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093316 2562 flags.go:64] FLAG: --runonce="false" Jul 21 17:26:16.100572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093319 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093322 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093324 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093327 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093330 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093333 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093335 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093338 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093341 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093345 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093348 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093350 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093353 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093356 2562 flags.go:64] FLAG: --system-cgroups="" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093359 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093364 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093368 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093370 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093374 2562 flags.go:64] FLAG: --tls-min-version="" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093377 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093380 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093383 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093386 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093389 2562 flags.go:64] FLAG: --v="2" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093393 2562 flags.go:64] FLAG: --version="false" Jul 21 17:26:16.101188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093397 2562 flags.go:64] FLAG: --vmodule="" Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093401 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.093404 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093516 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093521 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093524 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093527 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093530 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093533 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093535 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093538 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093540 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093543 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093546 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093548 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093551 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093572 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093574 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093577 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:26:16.101875 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093580 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093583 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093585 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093589 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093593 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093595 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093598 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093601 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093604 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093607 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093610 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093614 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093617 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093640 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093644 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093648 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093651 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093654 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093657 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:26:16.102333 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093659 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093662 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093665 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093668 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093671 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093674 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093676 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093679 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093681 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093684 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093689 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093692 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093695 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093697 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093700 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093703 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093705 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093708 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093710 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:26:16.102814 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093713 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093715 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093718 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093720 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093723 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093725 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093727 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093730 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093732 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093736 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093738 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093741 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093743 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093745 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093748 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093750 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093753 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093755 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093758 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093760 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093762 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:26:16.103288 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093765 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093767 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093772 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093774 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093777 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093779 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093782 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093784 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093787 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093789 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093791 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093794 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093797 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093799 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093801 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093804 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093806 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093809 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093811 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093814 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:26:16.103805 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093816 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093823 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093826 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.093828 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.095313 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.102020 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.102036 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.102057 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.102066 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102122 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102126 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102130 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102133 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102137 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:26:16.104371 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102140 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102142 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102146 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102149 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102152 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102156 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102160 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102163 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102166 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102169 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102172 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102174 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102177 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102180 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102182 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102185 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102188 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102190 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102193 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102196 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:26:16.104748 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102199 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102202 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102206 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102209 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102212 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102215 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102217 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102220 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102222 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102225 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102227 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102230 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102232 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102235 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102237 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102239 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102242 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102244 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102247 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:26:16.105234 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102249 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102252 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102254 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102256 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102259 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102261 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102264 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102266 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102269 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102271 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102274 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102277 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102279 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102282 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102284 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102287 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102290 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102293 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102295 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102298 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102300 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:26:16.105735 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102303 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102305 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102308 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102310 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102313 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102315 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102317 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102320 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102322 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102325 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102327 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102330 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102332 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102335 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102337 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102342 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102345 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102347 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102350 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:26:16.106278 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102353 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102355 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102358 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102360 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102363 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102366 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102369 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102372 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102374 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102378 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102380 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102383 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102386 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102388 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:26:16.106772 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102391 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.102396 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102514 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102519 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102522 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102525 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102527 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102530 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102532 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102535 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102538 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102540 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102543 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102545 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102548 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 17:26:16.107158 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102568 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102573 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102575 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102578 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102581 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102584 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102587 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102589 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102592 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102594 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102598 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102600 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102603 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102607 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102609 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102614 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102618 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102621 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102624 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 17:26:16.107521 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102627 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102629 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102633 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102636 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102638 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102641 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102644 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102647 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102649 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102652 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102654 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102657 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102659 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102662 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102664 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102667 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102669 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102671 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102674 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102676 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 17:26:16.108112 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102679 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102681 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102683 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102686 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102689 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102691 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102694 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102697 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102699 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102701 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102704 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102706 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102708 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102711 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102713 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102716 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102718 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102721 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102723 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 17:26:16.108606 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102725 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102728 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102730 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102733 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102735 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102737 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102740 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102742 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102744 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102747 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102749 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102751 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102754 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102756 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102758 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102761 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102763 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102766 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102770 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102774 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 17:26:16.109063 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102777 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102779 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102781 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102784 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102786 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102789 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102791 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:16.102793 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.102798 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.103635 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.105671 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.106773 2562 server.go:1019] "Starting client certificate rotation" Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.106875 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 17:26:16.109573 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.106947 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 17:26:16.109894 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.109303 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 17:26:16.113767 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.113751 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 17:26:16.126841 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.126813 2562 log.go:25] "Validated CRI v1 runtime API" Jul 21 17:26:16.129622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.129602 2562 log.go:25] "Validated CRI v1 image API" Jul 21 17:26:16.130523 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.130499 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 17:26:16.133432 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.133401 2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cfa5948e-4355-4fea-b155-00fef0149588:/dev/nvme0n1p4 d6580199-dd21-4232-9891-efbd0831dc0f:/dev/nvme0n1p3] Jul 21 17:26:16.133515 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.133430 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 17:26:16.139634 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.139495 2562 manager.go:216] Machine: {Timestamp:2026-07-21 17:26:16.137608738 +0000 UTC m=+0.323613608 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098735 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec262beea91be7e02ad891e5ebbb1841 SystemUUID:ec262bee-a91b-e7e0-2ad8-91e5ebbb1841 BootID:6d9922d2-e40d-4e9c-9891-ba56c26102f3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ae:40:4b:7f:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ae:40:4b:7f:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:f0:54:08:fb:f5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 17:26:16.139634 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.139621 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 17:26:16.139762 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.139708 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 17:26:16.142852 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.142827 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 17:26:16.142989 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.142855 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-6.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 17:26:16.144135 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.144120 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 17:26:16.144174 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.144140 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 17:26:16.144174 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.144151 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 17:26:16.145070 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.145057 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 17:26:16.146718 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.146707 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 17:26:16.147501 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.147484 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 17:26:16.149966 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.149952 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 21 17:26:16.150149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.150138 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 17:26:16.150182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.150173 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 21 17:26:16.150217 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.150189 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 17:26:16.150217 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.150209 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 17:26:16.150271 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.150222 2562 kubelet.go:398] "Adding apiserver pod source" Jul 21 17:26:16.150271 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.150234 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 17:26:16.150711 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.150686 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 17:26:16.150774 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.150727 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 17:26:16.152737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.152721 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 17:26:16.153956 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.153942 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 17:26:16.154043 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.153980 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 17:26:16.154570 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154538 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 17:26:16.154643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154579 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 17:26:16.154643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154589 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 17:26:16.154643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154598 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 17:26:16.154643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154611 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 17:26:16.154643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154619 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 17:26:16.154643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154632 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 17:26:16.154643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154642 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 17:26:16.154864 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154652 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 17:26:16.154864 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154660 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 17:26:16.154864 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154674 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 17:26:16.154864 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.154684 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 17:26:16.155943 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.155931 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 17:26:16.155993 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.155946 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 17:26:16.159504 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.159490 2562 server.go:1268] "Started kubelet" Jul 21 17:26:16.159667 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.159595 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 17:26:16.159797 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.159650 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 17:26:16.159905 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.159823 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 17:26:16.160414 ip-10-0-139-6 systemd[1]: Started Kubernetes Kubelet. Jul 21 17:26:16.161104 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.161086 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 17:26:16.162404 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.162390 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 21 17:26:16.166037 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.166018 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 17:26:16.166919 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.166904 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-6.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 17:26:16.167004 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.166985 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 17:26:16.167104 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.167086 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 17:26:16.167880 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.167046 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-6.ec2.internal.18c45e103bb055d7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-6.ec2.internal,UID:ip-10-0-139-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-6.ec2.internal,},FirstTimestamp:2026-07-21 17:26:16.159458775 +0000 UTC m=+0.345463645,LastTimestamp:2026-07-21 17:26:16.159458775 +0000 UTC m=+0.345463645,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-6.ec2.internal,}" Jul 21 17:26:16.168788 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.168772 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 17:26:16.168884 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.168777 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 17:26:16.169055 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.168987 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.169421 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.169402 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 17:26:16.169501 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.169433 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 17:26:16.169501 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.169448 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 17:26:16.169621 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.169577 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 21 17:26:16.169621 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.169589 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 21 17:26:16.171665 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.170305 2562 factory.go:55] Registering systemd factory Jul 21 17:26:16.171665 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.170332 2562 factory.go:223] Registration of the systemd container factory successfully Jul 21 17:26:16.172020 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.171925 2562 factory.go:153] Registering CRI-O factory Jul 21 17:26:16.172020 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.171945 2562 factory.go:223] Registration of the crio container factory successfully Jul 21 17:26:16.172020 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.171997 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 17:26:16.172020 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.172020 2562 factory.go:103] Registering Raw factory Jul 21 17:26:16.172519 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.172035 2562 manager.go:1196] Started watching for new ooms in manager Jul 21 17:26:16.172833 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.172799 2562 manager.go:349] Starting recovery of all containers Jul 21 17:26:16.181822 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.181791 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 17:26:16.181822 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.181807 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 17:26:16.183748 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.183453 2562 manager.go:354] Recovery completed Jul 21 17:26:16.184200 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.184175 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f6ctw" Jul 21 17:26:16.187794 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.187777 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:26:16.189651 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.189629 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:26:16.189729 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.189667 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:26:16.189729 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.189678 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:26:16.190200 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.190187 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 17:26:16.190200 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.190201 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 17:26:16.190282 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.190215 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:26:16.190282 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.190216 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 21 17:26:16.190920 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.190905 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:26:16.190980 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.190930 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:26:16.190980 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.190939 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:26:16.191485 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.191473 2562 policy_none.go:49] "None policy: Start" Jul 21 17:26:16.191518 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.191490 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 17:26:16.191518 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.191500 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 17:26:16.191840 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.191777 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-6.ec2.internal.18c45e103d7d0848 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-6.ec2.internal,UID:ip-10-0-139-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-6.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-6.ec2.internal,},FirstTimestamp:2026-07-21 17:26:16.189651016 +0000 UTC m=+0.375655889,LastTimestamp:2026-07-21 17:26:16.189651016 +0000 UTC m=+0.375655889,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-6.ec2.internal,}" Jul 21 17:26:16.192737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.192725 2562 policy_none.go:47] "Start" Jul 21 17:26:16.195939 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.195924 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f6ctw" Jul 21 17:26:16.201600 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.201518 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-6.ec2.internal.18c45e103d7d5efc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-6.ec2.internal,UID:ip-10-0-139-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-6.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-6.ec2.internal,},FirstTimestamp:2026-07-21 17:26:16.189673212 +0000 UTC m=+0.375678083,LastTimestamp:2026-07-21 17:26:16.189673212 +0000 UTC m=+0.375678083,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-6.ec2.internal,}" Jul 21 17:26:16.235234 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.235213 2562 manager.go:337] "Starting Device Plugin manager" Jul 21 17:26:16.235361 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.235249 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 17:26:16.235361 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.235259 2562 server.go:87] "Starting device plugin registration server" Jul 21 17:26:16.235596 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.235581 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 17:26:16.235652 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.235605 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 17:26:16.235714 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.235699 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 17:26:16.235785 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.235776 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 17:26:16.235785 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.235785 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 17:26:16.236337 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.236316 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 17:26:16.236418 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.236364 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.336798 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.336717 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:26:16.338025 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.337790 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:26:16.338025 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.337818 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:26:16.338025 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.337830 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:26:16.338025 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.337862 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.347470 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.347447 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.347517 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.347477 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-6.ec2.internal\": node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.352464 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.352430 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 17:26:16.353780 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.353763 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 17:26:16.353884 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.353798 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 17:26:16.353884 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.353819 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 17:26:16.353884 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.353848 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 17:26:16.356702 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.356684 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:26:16.361342 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.361316 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.454883 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.454822 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal"] Jul 21 17:26:16.455046 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.454924 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:26:16.455930 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.455914 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:26:16.456005 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.455945 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:26:16.456005 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.455959 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:26:16.457306 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.457292 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:26:16.457437 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.457420 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.457497 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.457457 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:26:16.458078 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.458058 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:26:16.458151 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.458091 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:26:16.458151 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.458101 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:26:16.458920 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.458896 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:26:16.459035 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.458928 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:26:16.459035 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.458942 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:26:16.460129 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.460112 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.460229 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.460144 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:26:16.460817 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.460801 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:26:16.460894 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.460831 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:26:16.460894 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.460841 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:26:16.462421 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.462406 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.471468 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.471449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beefaf4c01d4018b291c3b2ce27b1174-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal\" (UID: \"beefaf4c01d4018b291c3b2ce27b1174\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.471571 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.471479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f85b59baa01cccdade8441c60510cd6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-6.ec2.internal\" (UID: \"0f85b59baa01cccdade8441c60510cd6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.471571 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.471502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/beefaf4c01d4018b291c3b2ce27b1174-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal\" (UID: \"beefaf4c01d4018b291c3b2ce27b1174\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.492518 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.492491 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-6.ec2.internal\" not found" node="ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.497003 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.496985 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-6.ec2.internal\" not found" node="ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.563471 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.563441 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.571951 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.571922 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beefaf4c01d4018b291c3b2ce27b1174-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal\" (UID: \"beefaf4c01d4018b291c3b2ce27b1174\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.572085 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.571950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/beefaf4c01d4018b291c3b2ce27b1174-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal\" (UID: \"beefaf4c01d4018b291c3b2ce27b1174\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.572085 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.572001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f85b59baa01cccdade8441c60510cd6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-6.ec2.internal\" (UID: \"0f85b59baa01cccdade8441c60510cd6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.572085 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.572022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/beefaf4c01d4018b291c3b2ce27b1174-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal\" (UID: \"beefaf4c01d4018b291c3b2ce27b1174\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.572208 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.572087 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/beefaf4c01d4018b291c3b2ce27b1174-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal\" (UID: \"beefaf4c01d4018b291c3b2ce27b1174\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.572208 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.572113 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0f85b59baa01cccdade8441c60510cd6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-6.ec2.internal\" (UID: \"0f85b59baa01cccdade8441c60510cd6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.664503 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.664429 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.765120 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.765087 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.794700 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.794638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.800447 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:16.800427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" Jul 21 17:26:16.865473 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.865435 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:16.966515 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:16.966433 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:17.068266 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:17.068229 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:17.107694 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.107657 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 17:26:17.108148 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.107834 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 17:26:17.169246 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:17.169217 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:17.200374 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.200333 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 17:21:17 +0000 UTC" deadline="2028-03-08 14:55:27.283441757 +0000 UTC" Jul 21 17:26:17.200374 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.200370 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14301h29m10.083074895s" Jul 21 17:26:17.269755 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:17.269662 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:17.367064 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.367037 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 17:26:17.368351 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.368333 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientMemory" Jul 21 17:26:17.368413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.368370 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 17:26:17.368413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.368385 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeHasSufficientPID" Jul 21 17:26:17.370601 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:17.370581 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:17.413188 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:17.413149 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeefaf4c01d4018b291c3b2ce27b1174.slice/crio-81144a651c726d50764c85f5ef35a9aef69e9cbf2b9527bdb50c36b57ba36f6a WatchSource:0}: Error finding container 81144a651c726d50764c85f5ef35a9aef69e9cbf2b9527bdb50c36b57ba36f6a: Status 404 returned error can't find the container with id 81144a651c726d50764c85f5ef35a9aef69e9cbf2b9527bdb50c36b57ba36f6a Jul 21 17:26:17.413426 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:17.413402 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f85b59baa01cccdade8441c60510cd6.slice/crio-384e8df329c0b4acda7f1fd6f53042de9e4721a56009ab5edcca843c7515f928 WatchSource:0}: Error finding container 384e8df329c0b4acda7f1fd6f53042de9e4721a56009ab5edcca843c7515f928: Status 404 returned error can't find the container with id 384e8df329c0b4acda7f1fd6f53042de9e4721a56009ab5edcca843c7515f928 Jul 21 17:26:17.418304 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.418283 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 17:26:17.471573 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:17.471521 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:17.574476 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:17.574380 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-6.ec2.internal\" not found" Jul 21 17:26:17.599277 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.599241 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:26:17.606000 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.605973 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:26:17.670167 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.670117 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" Jul 21 17:26:17.684781 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.684752 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 17:26:17.685815 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.685800 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" Jul 21 17:26:17.694993 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.694966 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 17:26:17.751072 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:17.751045 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:26:18.056602 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.056495 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 17:26:18.151874 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.151836 2562 apiserver.go:52] "Watching apiserver" Jul 21 17:26:18.158158 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.158116 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 17:26:18.160392 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.160360 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-6qvds","openshift-multus/network-metrics-daemon-pxxk4","openshift-ovn-kubernetes/ovnkube-node-hf7wc","kube-system/konnectivity-agent-vvld2","kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal","openshift-dns/node-resolver-9db6r","openshift-image-registry/node-ca-gcz99","openshift-multus/multus-additional-cni-plugins-fj2lp","openshift-network-diagnostics/network-check-target-57xw5","openshift-network-operator/iptables-alerter-s6mtb","kube-system/global-pull-secret-syncer-fzpvb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm","openshift-cluster-node-tuning-operator/tuned-vrz7m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal"] Jul 21 17:26:18.162467 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.162441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.164322 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.164297 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.164436 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.164402 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:18.166246 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.165489 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.166246 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.165865 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 17:26:18.166246 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.166110 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 17:26:18.166246 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.166112 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 17:26:18.167053 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.166879 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2qn7t\"" Jul 21 17:26:18.167219 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.167200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:18.168177 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.168137 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 17:26:18.169252 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.168807 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 17:26:18.169252 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.168886 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.169252 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.169041 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q5n92\"" Jul 21 17:26:18.170875 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.170852 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 17:26:18.172522 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.172503 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 17:26:18.172763 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.172739 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 17:26:18.173852 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.173828 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 17:26:18.174174 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.174156 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 17:26:18.174260 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.174217 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 17:26:18.174516 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.174495 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 17:26:18.174654 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.174617 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d8t8h\"" Jul 21 17:26:18.174727 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.174666 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 17:26:18.174782 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.174719 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 17:26:18.175097 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.175080 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 17:26:18.175264 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.175242 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rhcjl\"" Jul 21 17:26:18.175403 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.175385 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 17:26:18.175674 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.175649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.177065 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.177042 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 17:26:18.177376 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.177354 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:18.177474 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.177417 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:18.178747 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.178727 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 17:26:18.179029 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.179011 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 17:26:18.179140 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.179123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lb7v5\"" Jul 21 17:26:18.180957 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.180934 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.181058 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181044 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:18.181122 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.181096 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:18.181208 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.181314 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-kubelet\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181314 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-run-netns\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181314 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181314 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5srgs\" (UniqueName: \"kubernetes.io/projected/e019c228-bb03-4f81-99ee-d0237aef0e96-kube-api-access-5srgs\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181529 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181326 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8v9\" (UniqueName: \"kubernetes.io/projected/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-kube-api-access-2v8v9\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.181529 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkbm7\" (UniqueName: \"kubernetes.io/projected/e5f53e19-4316-4c8c-a739-8d65012a31da-kube-api-access-tkbm7\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.181529 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:18.181529 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqz9q\" (UniqueName: \"kubernetes.io/projected/5e720559-add7-418c-aa6f-4a501dd40de3-kube-api-access-tqz9q\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.181529 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-etc-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181529 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-run-ovn-kubernetes\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181529 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-cni-netd\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-log-socket\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7b623b7-e33c-4b70-9582-362854fe68aa-dbus\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1e145bb-4282-4a1a-b554-e1906e78e23b-agent-certs\") pod \"konnectivity-agent-vvld2\" (UID: \"a1e145bb-4282-4a1a-b554-e1906e78e23b\") " pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181668 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f53e19-4316-4c8c-a739-8d65012a31da-tmp-dir\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-var-lib-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-env-overrides\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7b623b7-e33c-4b70-9582-362854fe68aa-kubelet-config\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-os-release\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-systemd-units\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-ovn\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-system-cni-dir\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.181942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e720559-add7-418c-aa6f-4a501dd40de3-host\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.181989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-ovnkube-script-lib\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cnibin\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cni-binary-copy\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5f53e19-4316-4c8c-a739-8d65012a31da-hosts-file\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-slash\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-systemd\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-node-log\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-cni-bin\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-ovnkube-config\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e019c228-bb03-4f81-99ee-d0237aef0e96-ovn-node-metrics-cert\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e720559-add7-418c-aa6f-4a501dd40de3-serviceca\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.182787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1e145bb-4282-4a1a-b554-e1906e78e23b-konnectivity-ca\") pod \"konnectivity-agent-vvld2\" (UID: \"a1e145bb-4282-4a1a-b554-e1906e78e23b\") " pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:18.183461 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.182869 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.184219 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.184181 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.185183 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.184475 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b4nm4\"" Jul 21 17:26:18.185183 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.184686 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:26:18.186404 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.186376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.197682 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.197493 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 17:26:18.199275 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.198833 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 17:26:18.199275 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.199074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 17:26:18.209086 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.209065 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 17:26:18.209247 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.209218 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 17:26:18.209316 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.209273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6qr87\"" Jul 21 17:26:18.211208 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.210894 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ts8mj\"" Jul 21 17:26:18.211208 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.211033 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 17:26:18.213958 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.213935 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 17:26:18.216759 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.216741 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 17:26:18.216759 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.216752 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 17:26:18.249617 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.249596 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpkt4\"" Jul 21 17:26:18.270226 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.270201 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 17:26:18.273746 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.273707 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-52w5n" Jul 21 17:26:18.282513 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-run-ovn-kubernetes\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.282657 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcl4x\" (UniqueName: \"kubernetes.io/projected/40433425-e249-449d-9abe-5999de1a0869-kube-api-access-mcl4x\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.282657 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282604 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-cnibin\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.282657 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282614 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-run-ovn-kubernetes\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.282657 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-kubelet\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.282806 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-conf-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.282806 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-log-socket\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.282806 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282727 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-log-socket\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.282806 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7b623b7-e33c-4b70-9582-362854fe68aa-dbus\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.282806 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.282806 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.282782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1e145bb-4282-4a1a-b554-e1906e78e23b-agent-certs\") pod \"konnectivity-agent-vvld2\" (UID: \"a1e145bb-4282-4a1a-b554-e1906e78e23b\") " pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:18.283096 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.282905 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:18.283096 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.282970 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret podName:d7b623b7-e33c-4b70-9582-362854fe68aa nodeName:}" failed. No retries permitted until 2026-07-21 17:26:18.782941855 +0000 UTC m=+2.968946728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret") pod "global-pull-secret-syncer-fzpvb" (UID: "d7b623b7-e33c-4b70-9582-362854fe68aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:18.283192 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.283192 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-registration-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.283313 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-cni-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.283313 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-hostroot\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.283313 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-kubernetes\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.283313 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f53e19-4316-4c8c-a739-8d65012a31da-tmp-dir\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.283313 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-env-overrides\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.283313 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7b623b7-e33c-4b70-9582-362854fe68aa-kubelet-config\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.283313 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-os-release\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-os-release\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6njj\" (UniqueName: \"kubernetes.io/projected/f928fc1d-da61-440f-a18f-fe4710664556-kube-api-access-d6njj\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-system-cni-dir\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-lib-modules\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-var-lib-kubelet\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40433425-e249-449d-9abe-5999de1a0869-iptables-alerter-script\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e720559-add7-418c-aa6f-4a501dd40de3-host\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cnibin\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cni-binary-copy\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-cni-bin\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-ovnkube-config\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.283560 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e019c228-bb03-4f81-99ee-d0237aef0e96-ovn-node-metrics-cert\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-tuned\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40433425-e249-449d-9abe-5999de1a0869-host-slash\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-cni-multus\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e720559-add7-418c-aa6f-4a501dd40de3-serviceca\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysctl-d\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283731 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-k8s-cni-cncf-io\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysctl-conf\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-multus-certs\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283796 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-cni-netd\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-socket-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada8b4fc-605a-435a-9c09-00844c9fb938-tmp\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7q9b\" (UniqueName: \"kubernetes.io/projected/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-kube-api-access-l7q9b\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.284149 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysconfig\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-host\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-netns\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-var-lib-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.283998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-device-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-modprobe-d\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f928fc1d-da61-440f-a18f-fe4710664556-cni-binary-copy\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-systemd-units\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-ovn\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px9b4\" (UniqueName: \"kubernetes.io/projected/ada8b4fc-605a-435a-9c09-00844c9fb938-kube-api-access-px9b4\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-socket-dir-parent\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284153 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-etc-kubernetes\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-ovnkube-script-lib\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-run\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-sys\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.284790 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-system-cni-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-cni-bin\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5f53e19-4316-4c8c-a739-8d65012a31da-hosts-file\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-slash\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-systemd\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-node-log\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmbbx\" (UniqueName: \"kubernetes.io/projected/82c06dd5-82f6-44e4-9470-07d3566635b6-kube-api-access-hmbbx\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1e145bb-4282-4a1a-b554-e1906e78e23b-konnectivity-ca\") pod \"konnectivity-agent-vvld2\" (UID: \"a1e145bb-4282-4a1a-b554-e1906e78e23b\") " pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f928fc1d-da61-440f-a18f-fe4710664556-multus-daemon-config\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-kubelet\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-run-netns\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5srgs\" (UniqueName: \"kubernetes.io/projected/e019c228-bb03-4f81-99ee-d0237aef0e96-kube-api-access-5srgs\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8v9\" (UniqueName: \"kubernetes.io/projected/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-kube-api-access-2v8v9\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-sys-fs\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-systemd\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284811 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-52w5n" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.284944 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 17:26:18.285572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.285477 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5f53e19-4316-4c8c-a739-8d65012a31da-hosts-file\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.286564 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.285657 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7b623b7-e33c-4b70-9582-362854fe68aa-dbus\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.286564 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286120 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-env-overrides\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.286564 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286207 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-slash\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.286564 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-systemd\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.286564 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286287 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-node-log\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.286564 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286402 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-kubelet\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.286564 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-run-netns\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.286564 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286509 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.286984 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.286984 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-var-lib-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.287093 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.287058 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-cni-netd\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.287147 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.287113 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-systemd-units\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.287207 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.287149 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-ovn\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.287207 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.286524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-ovnkube-config\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.287345 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.287213 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1e145bb-4282-4a1a-b554-e1906e78e23b-konnectivity-ca\") pod \"konnectivity-agent-vvld2\" (UID: \"a1e145bb-4282-4a1a-b554-e1906e78e23b\") " pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:18.287345 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.287275 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7b623b7-e33c-4b70-9582-362854fe68aa-kubelet-config\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.287345 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.287292 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-run-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.287500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.287360 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-os-release\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.288241 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.288212 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cni-binary-copy\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.288391 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.288365 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.288616 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e720559-add7-418c-aa6f-4a501dd40de3-host\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.288716 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-cnibin\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.288977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5f53e19-4316-4c8c-a739-8d65012a31da-tmp-dir\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289046 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-system-cni-dir\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289094 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-host-cni-bin\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289349 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkbm7\" (UniqueName: \"kubernetes.io/projected/e5f53e19-4316-4c8c-a739-8d65012a31da-kube-api-access-tkbm7\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289469 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqz9q\" (UniqueName: \"kubernetes.io/projected/5e720559-add7-418c-aa6f-4a501dd40de3-kube-api-access-tqz9q\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-etc-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289756 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e019c228-bb03-4f81-99ee-d0237aef0e96-ovn-node-metrics-cert\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289804 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5e720559-add7-418c-aa6f-4a501dd40de3-serviceca\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.289889 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e019c228-bb03-4f81-99ee-d0237aef0e96-etc-openvswitch\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.290284 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1e145bb-4282-4a1a-b554-e1906e78e23b-agent-certs\") pod \"konnectivity-agent-vvld2\" (UID: \"a1e145bb-4282-4a1a-b554-e1906e78e23b\") " pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:18.291622 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.290442 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e019c228-bb03-4f81-99ee-d0237aef0e96-ovnkube-script-lib\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.296160 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.296138 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:26:18.296282 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.296180 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:26:18.296282 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.296195 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rtbnt for pod openshift-network-diagnostics/network-check-target-57xw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:18.296282 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.296278 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt podName:5e8db8b1-4276-4eaa-923b-dc316b87f016 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:18.79626123 +0000 UTC m=+2.982266090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rtbnt" (UniqueName: "kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt") pod "network-check-target-57xw5" (UID: "5e8db8b1-4276-4eaa-923b-dc316b87f016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:18.297120 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.297092 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5srgs\" (UniqueName: \"kubernetes.io/projected/e019c228-bb03-4f81-99ee-d0237aef0e96-kube-api-access-5srgs\") pod \"ovnkube-node-hf7wc\" (UID: \"e019c228-bb03-4f81-99ee-d0237aef0e96\") " pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.299074 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.299051 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8v9\" (UniqueName: \"kubernetes.io/projected/5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2-kube-api-access-2v8v9\") pod \"multus-additional-cni-plugins-fj2lp\" (UID: \"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2\") " pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.301335 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.301298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkbm7\" (UniqueName: \"kubernetes.io/projected/e5f53e19-4316-4c8c-a739-8d65012a31da-kube-api-access-tkbm7\") pod \"node-resolver-9db6r\" (UID: \"e5f53e19-4316-4c8c-a739-8d65012a31da\") " pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.302583 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.302561 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqz9q\" (UniqueName: \"kubernetes.io/projected/5e720559-add7-418c-aa6f-4a501dd40de3-kube-api-access-tqz9q\") pod \"node-ca-gcz99\" (UID: \"5e720559-add7-418c-aa6f-4a501dd40de3\") " pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.360069 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.360004 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" event={"ID":"0f85b59baa01cccdade8441c60510cd6","Type":"ContainerStarted","Data":"384e8df329c0b4acda7f1fd6f53042de9e4721a56009ab5edcca843c7515f928"} Jul 21 17:26:18.362851 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.362805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" event={"ID":"beefaf4c01d4018b291c3b2ce27b1174","Type":"ContainerStarted","Data":"81144a651c726d50764c85f5ef35a9aef69e9cbf2b9527bdb50c36b57ba36f6a"} Jul 21 17:26:18.390458 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-hostroot\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-kubernetes\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-os-release\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6njj\" (UniqueName: \"kubernetes.io/projected/f928fc1d-da61-440f-a18f-fe4710664556-kube-api-access-d6njj\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-lib-modules\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390556 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-kubernetes\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-var-lib-kubelet\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390497 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-hostroot\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40433425-e249-449d-9abe-5999de1a0869-iptables-alerter-script\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390644 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-os-release\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.390664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-tuned\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40433425-e249-449d-9abe-5999de1a0869-host-slash\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-cni-multus\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysctl-d\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-k8s-cni-cncf-io\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysctl-conf\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-multus-certs\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-socket-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada8b4fc-605a-435a-9c09-00844c9fb938-tmp\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390847 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7q9b\" (UniqueName: \"kubernetes.io/projected/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-kube-api-access-l7q9b\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysconfig\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-host\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-netns\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-device-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-modprobe-d\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f928fc1d-da61-440f-a18f-fe4710664556-cni-binary-copy\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.391245 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9b4\" (UniqueName: \"kubernetes.io/projected/ada8b4fc-605a-435a-9c09-00844c9fb938-kube-api-access-px9b4\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.390993 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-socket-dir-parent\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-etc-kubernetes\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-run\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-sys\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-system-cni-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-cni-bin\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmbbx\" (UniqueName: \"kubernetes.io/projected/82c06dd5-82f6-44e4-9470-07d3566635b6-kube-api-access-hmbbx\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f928fc1d-da61-440f-a18f-fe4710664556-multus-daemon-config\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-sys-fs\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-systemd\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391185 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysctl-conf\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcl4x\" (UniqueName: \"kubernetes.io/projected/40433425-e249-449d-9abe-5999de1a0869-kube-api-access-mcl4x\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-cnibin\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391234 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-k8s-cni-cncf-io\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-kubelet\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.392107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-conf-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391271 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-multus-certs\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391317 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-conf-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391350 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysconfig\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.391353 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.391406 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs podName:82c06dd5-82f6-44e4-9470-07d3566635b6 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:18.891391693 +0000 UTC m=+3.077396553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs") pod "network-metrics-daemon-pxxk4" (UID: "82c06dd5-82f6-44e4-9470-07d3566635b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391468 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-socket-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391521 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40433425-e249-449d-9abe-5999de1a0869-host-slash\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391569 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-run-netns\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-device-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391690 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-sysctl-d\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391706 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-modprobe-d\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391794 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-cni-multus\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391845 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-host\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-registration-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-cni-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.391991 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-cni-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392041 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-registration-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392092 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-cni-bin\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392135 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f928fc1d-da61-440f-a18f-fe4710664556-cni-binary-copy\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392187 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-etc-selinux\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392481 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-multus-socket-dir-parent\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392537 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-etc-kubernetes\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392584 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392649 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-run\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392699 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-sys\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392733 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-system-cni-dir\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392814 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-cnibin\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392883 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f928fc1d-da61-440f-a18f-fe4710664556-multus-daemon-config\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392952 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-systemd\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.392994 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f928fc1d-da61-440f-a18f-fe4710664556-host-var-lib-kubelet\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.393012 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-sys-fs\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.393050 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-var-lib-kubelet\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.393093 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ada8b4fc-605a-435a-9c09-00844c9fb938-lib-modules\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.393946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.393545 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40433425-e249-449d-9abe-5999de1a0869-iptables-alerter-script\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.398423 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.398396 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada8b4fc-605a-435a-9c09-00844c9fb938-tmp\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.398921 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.398898 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ada8b4fc-605a-435a-9c09-00844c9fb938-etc-tuned\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.402633 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.402562 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7q9b\" (UniqueName: \"kubernetes.io/projected/5edf6fb6-a2ec-4ab6-834e-fb8e681fc618-kube-api-access-l7q9b\") pod \"aws-ebs-csi-driver-node-kjdrm\" (UID: \"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.431070 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.431033 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcl4x\" (UniqueName: \"kubernetes.io/projected/40433425-e249-449d-9abe-5999de1a0869-kube-api-access-mcl4x\") pod \"iptables-alerter-s6mtb\" (UID: \"40433425-e249-449d-9abe-5999de1a0869\") " pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.431238 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.431127 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmbbx\" (UniqueName: \"kubernetes.io/projected/82c06dd5-82f6-44e4-9470-07d3566635b6-kube-api-access-hmbbx\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:18.433430 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.433366 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6njj\" (UniqueName: \"kubernetes.io/projected/f928fc1d-da61-440f-a18f-fe4710664556-kube-api-access-d6njj\") pod \"multus-6qvds\" (UID: \"f928fc1d-da61-440f-a18f-fe4710664556\") " pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.435836 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.435810 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9b4\" (UniqueName: \"kubernetes.io/projected/ada8b4fc-605a-435a-9c09-00844c9fb938-kube-api-access-px9b4\") pod \"tuned-vrz7m\" (UID: \"ada8b4fc-605a-435a-9c09-00844c9fb938\") " pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.489427 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.489175 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gcz99" Jul 21 17:26:18.495667 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.495627 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:18.511223 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.511189 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:18.516493 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.516472 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" Jul 21 17:26:18.524996 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.524966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9db6r" Jul 21 17:26:18.533722 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.533689 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" Jul 21 17:26:18.541956 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.541932 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6mtb" Jul 21 17:26:18.550770 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.550741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6qvds" Jul 21 17:26:18.557340 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.557314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" Jul 21 17:26:18.794147 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.794054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:18.794334 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.794182 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:18.794334 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.794256 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret podName:d7b623b7-e33c-4b70-9582-362854fe68aa nodeName:}" failed. No retries permitted until 2026-07-21 17:26:19.79423888 +0000 UTC m=+3.980243739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret") pod "global-pull-secret-syncer-fzpvb" (UID: "d7b623b7-e33c-4b70-9582-362854fe68aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:18.895295 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.895251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:18.895497 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:18.895312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:18.895497 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.895383 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:18.895497 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.895460 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs podName:82c06dd5-82f6-44e4-9470-07d3566635b6 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:19.895441811 +0000 UTC m=+4.081446671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs") pod "network-metrics-daemon-pxxk4" (UID: "82c06dd5-82f6-44e4-9470-07d3566635b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:18.895695 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.895514 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:26:18.895695 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.895533 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:26:18.895695 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.895546 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rtbnt for pod openshift-network-diagnostics/network-check-target-57xw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:18.895695 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:18.895613 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt podName:5e8db8b1-4276-4eaa-923b-dc316b87f016 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:19.895598754 +0000 UTC m=+4.081603615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtbnt" (UniqueName: "kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt") pod "network-check-target-57xw5" (UID: "5e8db8b1-4276-4eaa-923b-dc316b87f016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:19.289696 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:19.289650 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 17:21:19 +0000 UTC" deadline="2028-04-28 07:22:31.07009136 +0000 UTC" Jul 21 17:26:19.289696 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:19.289690 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15517h56m11.780406395s" Jul 21 17:26:19.354551 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:19.354462 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:19.354730 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.354654 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:19.560565 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:19.560528 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode019c228_bb03_4f81_99ee_d0237aef0e96.slice/crio-1275be2ed70b6b04cfe1ad4b08833aa258beffda0d2d3be2941e83c0eb60ab21 WatchSource:0}: Error finding container 1275be2ed70b6b04cfe1ad4b08833aa258beffda0d2d3be2941e83c0eb60ab21: Status 404 returned error can't find the container with id 1275be2ed70b6b04cfe1ad4b08833aa258beffda0d2d3be2941e83c0eb60ab21 Jul 21 17:26:19.561366 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:19.561333 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edf6fb6_a2ec_4ab6_834e_fb8e681fc618.slice/crio-1853c7bb87ed06fe061854dc9c13ec0c95a85ac7149b04fe731aea8fbe6e3a16 WatchSource:0}: Error finding container 1853c7bb87ed06fe061854dc9c13ec0c95a85ac7149b04fe731aea8fbe6e3a16: Status 404 returned error can't find the container with id 1853c7bb87ed06fe061854dc9c13ec0c95a85ac7149b04fe731aea8fbe6e3a16 Jul 21 17:26:19.562836 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:19.562809 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf928fc1d_da61_440f_a18f_fe4710664556.slice/crio-bbaf8ebd92504aabf2bfc662ee04e8b93a07ec1ed2bc43079a5266d9bc2d52e0 WatchSource:0}: Error finding container bbaf8ebd92504aabf2bfc662ee04e8b93a07ec1ed2bc43079a5266d9bc2d52e0: Status 404 returned error can't find the container with id bbaf8ebd92504aabf2bfc662ee04e8b93a07ec1ed2bc43079a5266d9bc2d52e0 Jul 21 17:26:19.566194 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:19.566151 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f53e19_4316_4c8c_a739_8d65012a31da.slice/crio-fccb15e9b1d23623cd110f2517e0d8f38600d36a63fb19e35254e21b16bdddbd WatchSource:0}: Error finding container fccb15e9b1d23623cd110f2517e0d8f38600d36a63fb19e35254e21b16bdddbd: Status 404 returned error can't find the container with id fccb15e9b1d23623cd110f2517e0d8f38600d36a63fb19e35254e21b16bdddbd Jul 21 17:26:19.802557 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:19.802527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:19.802698 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.802679 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:19.802754 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.802745 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret podName:d7b623b7-e33c-4b70-9582-362854fe68aa nodeName:}" failed. No retries permitted until 2026-07-21 17:26:21.802729192 +0000 UTC m=+5.988734052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret") pod "global-pull-secret-syncer-fzpvb" (UID: "d7b623b7-e33c-4b70-9582-362854fe68aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:19.903578 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:19.903461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:19.903578 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:19.903562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:19.903779 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.903679 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:19.903779 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.903679 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:26:19.903779 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.903704 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:26:19.903779 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.903714 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rtbnt for pod openshift-network-diagnostics/network-check-target-57xw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:19.903779 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.903739 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs podName:82c06dd5-82f6-44e4-9470-07d3566635b6 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:21.903721217 +0000 UTC m=+6.089726095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs") pod "network-metrics-daemon-pxxk4" (UID: "82c06dd5-82f6-44e4-9470-07d3566635b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:19.903779 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:19.903760 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt podName:5e8db8b1-4276-4eaa-923b-dc316b87f016 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:21.9037465 +0000 UTC m=+6.089751360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtbnt" (UniqueName: "kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt") pod "network-check-target-57xw5" (UID: "5e8db8b1-4276-4eaa-923b-dc316b87f016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:20.290146 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.290047 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 17:21:19 +0000 UTC" deadline="2028-03-10 22:40:59.042691748 +0000 UTC" Jul 21 17:26:20.290146 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.290088 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14357h14m38.75260884s" Jul 21 17:26:20.355885 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.355848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:20.356079 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:20.355984 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:20.358244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.358217 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:20.358381 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:20.358362 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:20.380619 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.380571 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" event={"ID":"ada8b4fc-605a-435a-9c09-00844c9fb938","Type":"ContainerStarted","Data":"d79e43d3c8797b742dddee8bcb643ae268ccf3e77dac480bb337390b6041d080"} Jul 21 17:26:20.386664 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.386555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gcz99" event={"ID":"5e720559-add7-418c-aa6f-4a501dd40de3","Type":"ContainerStarted","Data":"8f3ad9899c1383de366721b1f16f56df5f14bc83b1c10efdc1082dd57fc6c8b9"} Jul 21 17:26:20.391382 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.391312 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9db6r" event={"ID":"e5f53e19-4316-4c8c-a739-8d65012a31da","Type":"ContainerStarted","Data":"fccb15e9b1d23623cd110f2517e0d8f38600d36a63fb19e35254e21b16bdddbd"} Jul 21 17:26:20.398730 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.398609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qvds" event={"ID":"f928fc1d-da61-440f-a18f-fe4710664556","Type":"ContainerStarted","Data":"bbaf8ebd92504aabf2bfc662ee04e8b93a07ec1ed2bc43079a5266d9bc2d52e0"} Jul 21 17:26:20.406394 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.406360 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" event={"ID":"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618","Type":"ContainerStarted","Data":"1853c7bb87ed06fe061854dc9c13ec0c95a85ac7149b04fe731aea8fbe6e3a16"} Jul 21 17:26:20.423531 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.422799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" event={"ID":"0f85b59baa01cccdade8441c60510cd6","Type":"ContainerStarted","Data":"92793a5657b9855d03caf05ac1ee2678af457bf9d15aabc0af6d97320e3bb26f"} Jul 21 17:26:20.444048 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.444000 2562 generic.go:356] "Generic (PLEG): container finished" podID="beefaf4c01d4018b291c3b2ce27b1174" containerID="fb2abd987b17d7c72b72f18944e2564169f674418428b1caa09d48516da614bb" exitCode=0 Jul 21 17:26:20.444237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.444106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" event={"ID":"beefaf4c01d4018b291c3b2ce27b1174","Type":"ContainerDied","Data":"fb2abd987b17d7c72b72f18944e2564169f674418428b1caa09d48516da614bb"} Jul 21 17:26:20.452755 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.452722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6mtb" event={"ID":"40433425-e249-449d-9abe-5999de1a0869","Type":"ContainerStarted","Data":"b9b9da1aaf88fd0fe16dd084f8d34b4563a70ad00d0566370781fe82d57aa274"} Jul 21 17:26:20.468768 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.468703 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-6.ec2.internal" podStartSLOduration=2.468680875 podStartE2EDuration="2.468680875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:20.442398209 +0000 UTC m=+4.628403095" watchObservedRunningTime="2026-07-21 17:26:20.468680875 +0000 UTC m=+4.654685761" Jul 21 17:26:20.472777 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.472681 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerStarted","Data":"1bcaade4c8639236ab1edf0246b9f4964f1ffb86af71d221a5fee40c9796edf8"} Jul 21 17:26:20.482608 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.482519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"1275be2ed70b6b04cfe1ad4b08833aa258beffda0d2d3be2941e83c0eb60ab21"} Jul 21 17:26:20.487711 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:20.487681 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vvld2" event={"ID":"a1e145bb-4282-4a1a-b554-e1906e78e23b","Type":"ContainerStarted","Data":"70c26b96d6c70b0a74b279c711c7b7bb72f3d62e9ee48d74ed07377beecc7e55"} Jul 21 17:26:21.354660 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:21.354610 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:21.355226 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.354773 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:21.524548 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:21.524508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" event={"ID":"beefaf4c01d4018b291c3b2ce27b1174","Type":"ContainerStarted","Data":"1faead919e64e45b2ca59d7fa14cba5e9e33c243b84e88e995c368c98d527fe4"} Jul 21 17:26:21.822127 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:21.822031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:21.822315 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.822240 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:21.822315 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.822309 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret podName:d7b623b7-e33c-4b70-9582-362854fe68aa nodeName:}" failed. No retries permitted until 2026-07-21 17:26:25.822288579 +0000 UTC m=+10.008293445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret") pod "global-pull-secret-syncer-fzpvb" (UID: "d7b623b7-e33c-4b70-9582-362854fe68aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:21.923057 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:21.923013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:21.923257 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:21.923077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:21.923257 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.923232 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:26:21.923257 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.923255 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:26:21.923438 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.923268 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rtbnt for pod openshift-network-diagnostics/network-check-target-57xw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:21.923438 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.923334 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt podName:5e8db8b1-4276-4eaa-923b-dc316b87f016 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:25.923314196 +0000 UTC m=+10.109319058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtbnt" (UniqueName: "kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt") pod "network-check-target-57xw5" (UID: "5e8db8b1-4276-4eaa-923b-dc316b87f016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:21.923802 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.923777 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:21.923877 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:21.923840 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs podName:82c06dd5-82f6-44e4-9470-07d3566635b6 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:25.923823172 +0000 UTC m=+10.109828032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs") pod "network-metrics-daemon-pxxk4" (UID: "82c06dd5-82f6-44e4-9470-07d3566635b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:22.358139 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:22.357381 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:22.358139 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:22.357543 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:22.358139 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:22.357982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:22.358139 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:22.358080 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:23.354248 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:23.354192 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:23.354450 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:23.354396 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:24.355754 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:24.355716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:24.356278 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:24.355863 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:24.356406 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:24.356383 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:24.356530 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:24.356505 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:25.355047 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:25.355000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:25.355239 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.355157 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:25.863903 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:25.863851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:25.864440 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.864042 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:25.864440 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.864127 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret podName:d7b623b7-e33c-4b70-9582-362854fe68aa nodeName:}" failed. No retries permitted until 2026-07-21 17:26:33.864100317 +0000 UTC m=+18.050105189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret") pod "global-pull-secret-syncer-fzpvb" (UID: "d7b623b7-e33c-4b70-9582-362854fe68aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:25.964581 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:25.964533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:25.964826 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:25.964603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:25.964826 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.964801 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:26:25.964826 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.964821 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:26:25.964826 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.964835 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rtbnt for pod openshift-network-diagnostics/network-check-target-57xw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:25.965090 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.964894 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt podName:5e8db8b1-4276-4eaa-923b-dc316b87f016 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:33.964873962 +0000 UTC m=+18.150878828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtbnt" (UniqueName: "kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt") pod "network-check-target-57xw5" (UID: "5e8db8b1-4276-4eaa-923b-dc316b87f016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:25.965349 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.965307 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:25.965493 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:25.965362 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs podName:82c06dd5-82f6-44e4-9470-07d3566635b6 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:33.965346312 +0000 UTC m=+18.151351172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs") pod "network-metrics-daemon-pxxk4" (UID: "82c06dd5-82f6-44e4-9470-07d3566635b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:26.355425 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:26.355338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:26.355629 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:26.355474 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:26.355629 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:26.355582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:26.355777 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:26.355723 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:27.354712 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:27.354671 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:27.355263 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:27.354804 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:28.354765 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:28.354721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:28.355118 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:28.354736 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:28.355118 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:28.354861 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:28.355118 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:28.354923 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:29.354078 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:29.354038 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:29.354252 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:29.354164 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:30.354153 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:30.354121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:30.354634 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:30.354248 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:30.354634 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:30.354266 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:30.354634 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:30.354375 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:31.354796 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:31.354766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:31.355201 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:31.354877 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:32.354571 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:32.354507 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:32.354571 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:32.354541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:32.354811 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:32.354680 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:32.355153 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:32.354815 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:33.354521 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:33.354481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:33.354711 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:33.354619 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:33.928822 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:33.928773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:33.929330 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:33.928903 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:33.929330 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:33.928977 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret podName:d7b623b7-e33c-4b70-9582-362854fe68aa nodeName:}" failed. No retries permitted until 2026-07-21 17:26:49.928954824 +0000 UTC m=+34.114959699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret") pod "global-pull-secret-syncer-fzpvb" (UID: "d7b623b7-e33c-4b70-9582-362854fe68aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:34.029944 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:34.029899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:34.030123 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:34.029961 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:34.030123 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:34.030070 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:34.030247 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:34.030132 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:26:34.030247 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:34.030143 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs podName:82c06dd5-82f6-44e4-9470-07d3566635b6 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:50.030121292 +0000 UTC m=+34.216126153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs") pod "network-metrics-daemon-pxxk4" (UID: "82c06dd5-82f6-44e4-9470-07d3566635b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:34.030247 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:34.030150 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:26:34.030247 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:34.030162 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rtbnt for pod openshift-network-diagnostics/network-check-target-57xw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:34.030247 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:34.030221 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt podName:5e8db8b1-4276-4eaa-923b-dc316b87f016 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:50.030189086 +0000 UTC m=+34.216193944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtbnt" (UniqueName: "kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt") pod "network-check-target-57xw5" (UID: "5e8db8b1-4276-4eaa-923b-dc316b87f016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:34.354419 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:34.354346 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:34.354595 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:34.354352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:34.354595 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:34.354492 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:34.354748 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:34.354601 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:35.354946 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:35.354910 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:35.355385 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:35.355055 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:36.355311 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:36.355275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:36.355774 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:36.355383 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:36.355774 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:36.355457 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:36.355774 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:36.355547 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:37.354202 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:37.354170 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:37.354366 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:37.354272 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:38.354900 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:38.354863 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:38.355446 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:38.354996 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:38.355446 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:38.355037 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:38.355446 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:38.355115 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:39.354210 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.353965 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:39.354356 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:39.354287 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:39.563409 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.563381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vvld2" event={"ID":"a1e145bb-4282-4a1a-b554-e1906e78e23b","Type":"ContainerStarted","Data":"eba8b9e247a9f0d9d323f7339cb0046cbba81eef085e4c09f14346b807c21a9a"} Jul 21 17:26:39.564833 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.564807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" event={"ID":"ada8b4fc-605a-435a-9c09-00844c9fb938","Type":"ContainerStarted","Data":"6c52315d8c49896bf4697d2e1a92f44442e0ac1773358b83c0e99f3fef231bdc"} Jul 21 17:26:39.566070 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.566049 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gcz99" event={"ID":"5e720559-add7-418c-aa6f-4a501dd40de3","Type":"ContainerStarted","Data":"f20518b48622f1fe3b58026d2c6d58cf47b62628613e89f0b6b3998359a27f09"} Jul 21 17:26:39.567366 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.567332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9db6r" event={"ID":"e5f53e19-4316-4c8c-a739-8d65012a31da","Type":"ContainerStarted","Data":"2ac7294d3df9882c68a6e6a5236b806443072b40788a2f9eeccc5b6cc95a1ad4"} Jul 21 17:26:39.568997 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.568968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6qvds" event={"ID":"f928fc1d-da61-440f-a18f-fe4710664556","Type":"ContainerStarted","Data":"bb322ba579e7985dae1a375b9e246be776454f89788070e231c2961c29e11b2a"} Jul 21 17:26:39.570852 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.570682 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" event={"ID":"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618","Type":"ContainerStarted","Data":"bb1dfd7d1bbf634c795d6a9480a74987d17c48960eb9cb236dd5319c8e6d6291"} Jul 21 17:26:39.572677 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.572541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerStarted","Data":"9bbb8efd12e55e1e696e445e3e028c1fcd186d08503e568022eac9c842795a80"} Jul 21 17:26:39.574296 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.574270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"d5311e70f8bbb13e939726a688b3080a53a6d186150f8e7c9b3828c91e1e1eb9"} Jul 21 17:26:39.574377 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.574356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"f9c53e4b4323c8bb3d20d79e42269c9a0c282aefc6901b08cb4772870f87a4da"} Jul 21 17:26:39.583464 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.583407 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-6.ec2.internal" podStartSLOduration=21.583386729 podStartE2EDuration="21.583386729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:21.54344672 +0000 UTC m=+5.729451604" watchObservedRunningTime="2026-07-21 17:26:39.583386729 +0000 UTC m=+23.769391610" Jul 21 17:26:39.583940 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.583902 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vvld2" podStartSLOduration=7.807468921 podStartE2EDuration="22.583889428s" totalImagesPullingTime="14.776420507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:39.582983954 +0000 UTC m=+23.768988831" watchObservedRunningTime="2026-07-21 17:26:39.583889428 +0000 UTC m=+23.769894308" Jul 21 17:26:39.603210 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.603164 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gcz99" podStartSLOduration=2.990535349 podStartE2EDuration="22.603145409s" totalImagesPullingTime="19.61261006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:39.60263516 +0000 UTC m=+23.788640043" watchObservedRunningTime="2026-07-21 17:26:39.603145409 +0000 UTC m=+23.789150289" Jul 21 17:26:39.657607 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.657543 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6qvds" podStartSLOduration=3.008923428 podStartE2EDuration="22.657528559s" totalImagesPullingTime="19.648605131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:39.657491169 +0000 UTC m=+23.843496048" watchObservedRunningTime="2026-07-21 17:26:39.657528559 +0000 UTC m=+23.843533438" Jul 21 17:26:39.657877 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:39.657856 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9db6r" podStartSLOduration=3.04156222 podStartE2EDuration="22.657849941s" totalImagesPullingTime="19.616287721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:39.628201579 +0000 UTC m=+23.814206461" watchObservedRunningTime="2026-07-21 17:26:39.657849941 +0000 UTC m=+23.843854821" Jul 21 17:26:40.287928 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.287737 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 17:26:40.354947 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.354918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:40.355090 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:40.355035 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:40.355135 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.355092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:40.355198 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:40.355181 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:40.577748 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.577651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" event={"ID":"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618","Type":"ContainerStarted","Data":"257b0f52b69460995b3f011d01ab582b29492cc30de6f0a8af9c6979be4db2d0"} Jul 21 17:26:40.579201 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.579174 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6mtb" event={"ID":"40433425-e249-449d-9abe-5999de1a0869","Type":"ContainerStarted","Data":"e00f9f65336877fe6934161a80c4f878cf117ddd4eeabb353125ee0a31e4ccc3"} Jul 21 17:26:40.580530 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.580507 2562 generic.go:356] "Generic (PLEG): container finished" podID="5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2" containerID="9bbb8efd12e55e1e696e445e3e028c1fcd186d08503e568022eac9c842795a80" exitCode=0 Jul 21 17:26:40.580637 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.580595 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerDied","Data":"9bbb8efd12e55e1e696e445e3e028c1fcd186d08503e568022eac9c842795a80"} Jul 21 17:26:40.583311 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.583286 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:26:40.583650 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.583630 2562 generic.go:356] "Generic (PLEG): container finished" podID="e019c228-bb03-4f81-99ee-d0237aef0e96" containerID="d5311e70f8bbb13e939726a688b3080a53a6d186150f8e7c9b3828c91e1e1eb9" exitCode=1 Jul 21 17:26:40.583740 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.583719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerDied","Data":"d5311e70f8bbb13e939726a688b3080a53a6d186150f8e7c9b3828c91e1e1eb9"} Jul 21 17:26:40.583815 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.583800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"f4b8a72cdf07fde67f93b13af406c3e5675e83887b9f7f6aa1c2ce1e8b53e0af"} Jul 21 17:26:40.583869 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.583856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"87ef21f370c3def9a1e90438974720a1a149590311bb37a006768090f9037b5c"} Jul 21 17:26:40.583920 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.583907 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"9719c2f76a2d838f462a926fa6ce56a955612638631f8effb85049aa2ae6ab8b"} Jul 21 17:26:40.583959 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.583950 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"7ae2e38d9c7eec244080ce55f630f381e8d424297eb439914188863578a70722"} Jul 21 17:26:40.594931 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.594890 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vrz7m" podStartSLOduration=3.982226294 podStartE2EDuration="23.594877348s" totalImagesPullingTime="19.612651054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:39.708053449 +0000 UTC m=+23.894058328" watchObservedRunningTime="2026-07-21 17:26:40.594877348 +0000 UTC m=+24.780882229" Jul 21 17:26:40.625606 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:40.625535 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s6mtb" podStartSLOduration=4.014712319 podStartE2EDuration="23.625520277s" totalImagesPullingTime="19.610807958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:40.59472136 +0000 UTC m=+24.780726244" watchObservedRunningTime="2026-07-21 17:26:40.625520277 +0000 UTC m=+24.811525156" Jul 21 17:26:41.249055 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:41.248953 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T17:26:40.287890052Z","UUID":"95c09d87-3de3-4283-8b94-97a577bb09de","Handler":null,"Name":"","Endpoint":""} Jul 21 17:26:41.250369 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:41.250343 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 17:26:41.250518 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:41.250388 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 17:26:41.354680 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:41.354593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:41.354825 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:41.354738 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:41.588848 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:41.588815 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" event={"ID":"5edf6fb6-a2ec-4ab6-834e-fb8e681fc618","Type":"ContainerStarted","Data":"8adc11c19811ec759abd2272688f22acb1f704ec53117082026f387045bd4275"} Jul 21 17:26:41.609082 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:41.608979 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kjdrm" podStartSLOduration=3.4219186329999998 podStartE2EDuration="24.608954913s" totalImagesPullingTime="21.18703628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:41.60856864 +0000 UTC m=+25.794573522" watchObservedRunningTime="2026-07-21 17:26:41.608954913 +0000 UTC m=+25.794959815" Jul 21 17:26:41.937033 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:41.936953 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:41.937701 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:41.937675 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:42.355016 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:42.354801 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:42.355152 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:42.354852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:42.355152 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:42.355124 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:42.355262 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:42.355220 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:42.594616 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:42.594524 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:26:42.595018 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:42.594939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"ffa7f0f5a7ce116e8e08dba7e9d37e15adb5fa269ef40c206f419ee67b7de32c"} Jul 21 17:26:42.595257 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:42.595231 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:42.595717 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:42.595688 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vvld2" Jul 21 17:26:43.354443 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:43.354412 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:43.354680 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:43.354524 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:44.354273 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:44.354198 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:44.354273 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:44.354248 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:44.354970 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:44.354352 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:44.354970 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:44.354460 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:45.354900 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.354650 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:45.355356 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:45.354914 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:45.602980 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.602949 2562 generic.go:356] "Generic (PLEG): container finished" podID="5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2" containerID="dbe95e291d237e35dad1b3ef9c4cfd7e0f4ebb9fc13df6931dc3756a1d8709c9" exitCode=0 Jul 21 17:26:45.603147 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.603010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerDied","Data":"dbe95e291d237e35dad1b3ef9c4cfd7e0f4ebb9fc13df6931dc3756a1d8709c9"} Jul 21 17:26:45.606413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.606332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:26:45.606719 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.606695 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"884b1b0e0d914b9c07ce95af6139f4d6276a0f36e53890751b9baf2ba0b8bf15"} Jul 21 17:26:45.606997 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.606982 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:45.607081 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.607060 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:45.607186 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.607160 2562 scope.go:117] "RemoveContainer" containerID="d5311e70f8bbb13e939726a688b3080a53a6d186150f8e7c9b3828c91e1e1eb9" Jul 21 17:26:45.623599 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:45.623575 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:46.355329 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.355302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:46.355697 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.355348 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:46.355697 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:46.355441 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:46.355697 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:46.355577 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:46.612650 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.612443 2562 generic.go:356] "Generic (PLEG): container finished" podID="5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2" containerID="116b5afc981e510528159b30e0ed537427f8a47c77142cdd2274340254b80286" exitCode=0 Jul 21 17:26:46.612825 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.612523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerDied","Data":"116b5afc981e510528159b30e0ed537427f8a47c77142cdd2274340254b80286"} Jul 21 17:26:46.619154 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.619134 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:26:46.619599 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.619576 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" event={"ID":"e019c228-bb03-4f81-99ee-d0237aef0e96","Type":"ContainerStarted","Data":"bfce9772ab176e5fce43358a85dfb15dda8aef0ea42cb09a7edaf0a83ee7fab9"} Jul 21 17:26:46.619891 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.619862 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:46.635674 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.635651 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:26:46.666004 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.665955 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" podStartSLOduration=9.987924296 podStartE2EDuration="29.665937353s" totalImagesPullingTime="19.678013057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:46.664731216 +0000 UTC m=+30.850736097" watchObservedRunningTime="2026-07-21 17:26:46.665937353 +0000 UTC m=+30.851942234" Jul 21 17:26:46.785314 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.785275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzpvb"] Jul 21 17:26:46.785476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.785441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:46.785619 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:46.785584 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:46.788056 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.788033 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pxxk4"] Jul 21 17:26:46.788142 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.788135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:46.788242 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:46.788224 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:46.802125 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.802064 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-57xw5"] Jul 21 17:26:46.802240 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:46.802153 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:46.802240 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:46.802220 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:47.624216 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:47.624125 2562 generic.go:356] "Generic (PLEG): container finished" podID="5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2" containerID="38f7f58d3f51a648ed4788471ae20ec912a12c9f4fc4bf078a1745e26e9d34a0" exitCode=0 Jul 21 17:26:47.624717 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:47.624209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerDied","Data":"38f7f58d3f51a648ed4788471ae20ec912a12c9f4fc4bf078a1745e26e9d34a0"} Jul 21 17:26:48.354187 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:48.354149 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:48.354371 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:48.354150 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:48.354371 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:48.354285 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:48.354504 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:48.354380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:48.354504 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:48.354379 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:48.354504 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:48.354491 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:49.944815 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:49.944778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:49.945480 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:49.944931 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:49.945480 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:49.944993 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret podName:d7b623b7-e33c-4b70-9582-362854fe68aa nodeName:}" failed. No retries permitted until 2026-07-21 17:27:21.944973752 +0000 UTC m=+66.130978610 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret") pod "global-pull-secret-syncer-fzpvb" (UID: "d7b623b7-e33c-4b70-9582-362854fe68aa") : object "kube-system"/"original-pull-secret" not registered Jul 21 17:26:50.045696 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:50.045661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:50.045871 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:50.045761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:50.045930 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.045882 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:50.045930 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.045885 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 17:26:50.045930 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.045907 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 17:26:50.045930 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.045926 2562 projected.go:196] Error preparing data for projected volume kube-api-access-rtbnt for pod openshift-network-diagnostics/network-check-target-57xw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:50.046118 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.045947 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs podName:82c06dd5-82f6-44e4-9470-07d3566635b6 nodeName:}" failed. No retries permitted until 2026-07-21 17:27:22.045922063 +0000 UTC m=+66.231926922 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs") pod "network-metrics-daemon-pxxk4" (UID: "82c06dd5-82f6-44e4-9470-07d3566635b6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 17:26:50.046118 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.045973 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt podName:5e8db8b1-4276-4eaa-923b-dc316b87f016 nodeName:}" failed. No retries permitted until 2026-07-21 17:27:22.045952855 +0000 UTC m=+66.231957713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rtbnt" (UniqueName: "kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt") pod "network-check-target-57xw5" (UID: "5e8db8b1-4276-4eaa-923b-dc316b87f016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 17:26:50.354465 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:50.354435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:50.354663 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:50.354435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:50.354663 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:50.354575 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:50.354663 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.354572 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-57xw5" podUID="5e8db8b1-4276-4eaa-923b-dc316b87f016" Jul 21 17:26:50.354663 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.354645 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzpvb" podUID="d7b623b7-e33c-4b70-9582-362854fe68aa" Jul 21 17:26:50.354860 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:50.354733 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pxxk4" podUID="82c06dd5-82f6-44e4-9470-07d3566635b6" Jul 21 17:26:52.078158 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.078128 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-6.ec2.internal" event="NodeReady" Jul 21 17:26:52.078619 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.078259 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 17:26:52.142292 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.142211 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z57wh"] Jul 21 17:26:52.172597 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.172547 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5c9w4"] Jul 21 17:26:52.172739 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.172656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.179082 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.178948 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 17:26:52.179082 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.178954 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 17:26:52.179082 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.179003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s47cz\"" Jul 21 17:26:52.190947 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.190925 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5c9w4"] Jul 21 17:26:52.190947 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.190952 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z57wh"] Jul 21 17:26:52.191111 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.191029 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5c9w4" Jul 21 17:26:52.193955 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.193936 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 17:26:52.194756 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.194731 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 17:26:52.194869 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.194770 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-brt6b\"" Jul 21 17:26:52.194869 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.194806 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 17:26:52.261351 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.261318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.261512 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.261377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc1c7421-626d-4e71-acc4-e73e924995dd-config-volume\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.261512 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.261399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qkp\" (UniqueName: \"kubernetes.io/projected/bc1c7421-626d-4e71-acc4-e73e924995dd-kube-api-access-d9qkp\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.261512 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.261428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc1c7421-626d-4e71-acc4-e73e924995dd-tmp-dir\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.354270 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.354241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:26:52.354398 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.354241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:26:52.354398 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.354385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:26:52.357619 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.357597 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sfsp8\"" Jul 21 17:26:52.357776 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.357759 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9vqxq\"" Jul 21 17:26:52.357872 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.357854 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 17:26:52.358022 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.358005 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 17:26:52.358315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.358298 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 17:26:52.358391 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.358301 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 17:26:52.361852 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.361836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t4pr\" (UniqueName: \"kubernetes.io/projected/0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae-kube-api-access-6t4pr\") pod \"ingress-canary-5c9w4\" (UID: \"0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae\") " pod="openshift-ingress-canary/ingress-canary-5c9w4" Jul 21 17:26:52.361951 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.361864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc1c7421-626d-4e71-acc4-e73e924995dd-config-volume\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.361951 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.361884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qkp\" (UniqueName: \"kubernetes.io/projected/bc1c7421-626d-4e71-acc4-e73e924995dd-kube-api-access-d9qkp\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.361951 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.361909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae-cert\") pod \"ingress-canary-5c9w4\" (UID: \"0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae\") " pod="openshift-ingress-canary/ingress-canary-5c9w4" Jul 21 17:26:52.361951 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.361944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc1c7421-626d-4e71-acc4-e73e924995dd-tmp-dir\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.363309 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.362014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.363309 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:52.362122 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:26:52.363309 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:52.362176 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls podName:bc1c7421-626d-4e71-acc4-e73e924995dd nodeName:}" failed. No retries permitted until 2026-07-21 17:26:52.862156458 +0000 UTC m=+37.048161316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls") pod "dns-default-z57wh" (UID: "bc1c7421-626d-4e71-acc4-e73e924995dd") : secret "dns-default-metrics-tls" not found Jul 21 17:26:52.363309 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.362303 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc1c7421-626d-4e71-acc4-e73e924995dd-tmp-dir\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.363309 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.362529 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bc1c7421-626d-4e71-acc4-e73e924995dd-config-volume\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.376450 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.376422 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qkp\" (UniqueName: \"kubernetes.io/projected/bc1c7421-626d-4e71-acc4-e73e924995dd-kube-api-access-d9qkp\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.463466 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.463223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t4pr\" (UniqueName: \"kubernetes.io/projected/0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae-kube-api-access-6t4pr\") pod \"ingress-canary-5c9w4\" (UID: \"0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae\") " pod="openshift-ingress-canary/ingress-canary-5c9w4" Jul 21 17:26:52.463629 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.463495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae-cert\") pod \"ingress-canary-5c9w4\" (UID: \"0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae\") " pod="openshift-ingress-canary/ingress-canary-5c9w4" Jul 21 17:26:52.466272 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.466246 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae-cert\") pod \"ingress-canary-5c9w4\" (UID: \"0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae\") " pod="openshift-ingress-canary/ingress-canary-5c9w4" Jul 21 17:26:52.472362 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.472331 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t4pr\" (UniqueName: \"kubernetes.io/projected/0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae-kube-api-access-6t4pr\") pod \"ingress-canary-5c9w4\" (UID: \"0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae\") " pod="openshift-ingress-canary/ingress-canary-5c9w4" Jul 21 17:26:52.499587 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.499530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5c9w4" Jul 21 17:26:52.640167 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.640135 2562 generic.go:356] "Generic (PLEG): container finished" podID="5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2" containerID="7e123d55dddcc78c553c7b1bb26cc0df7276a34b144ffab140725e8fece931e0" exitCode=0 Jul 21 17:26:52.640307 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.640189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerDied","Data":"7e123d55dddcc78c553c7b1bb26cc0df7276a34b144ffab140725e8fece931e0"} Jul 21 17:26:52.680086 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.680061 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5c9w4"] Jul 21 17:26:52.686471 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:52.686416 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1bfe4d_8e2a_4c07_a9e0_736ee54eeaae.slice/crio-42fc1dd0d87dd5d18eb5fe9f33c91a8a8ba54c27aef75ff9f085c54e06a8b852 WatchSource:0}: Error finding container 42fc1dd0d87dd5d18eb5fe9f33c91a8a8ba54c27aef75ff9f085c54e06a8b852: Status 404 returned error can't find the container with id 42fc1dd0d87dd5d18eb5fe9f33c91a8a8ba54c27aef75ff9f085c54e06a8b852 Jul 21 17:26:52.866757 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:52.866716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:52.866927 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:52.866895 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:26:52.866977 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:52.866971 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls podName:bc1c7421-626d-4e71-acc4-e73e924995dd nodeName:}" failed. No retries permitted until 2026-07-21 17:26:53.866954533 +0000 UTC m=+38.052959391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls") pod "dns-default-z57wh" (UID: "bc1c7421-626d-4e71-acc4-e73e924995dd") : secret "dns-default-metrics-tls" not found Jul 21 17:26:53.647072 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:53.646994 2562 generic.go:356] "Generic (PLEG): container finished" podID="5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2" containerID="3b0f2784b71bc86945919b2ac0510e6ea827ce17828e6b5fbba9b2d28939a161" exitCode=0 Jul 21 17:26:53.647521 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:53.647097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerDied","Data":"3b0f2784b71bc86945919b2ac0510e6ea827ce17828e6b5fbba9b2d28939a161"} Jul 21 17:26:53.648680 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:53.648509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5c9w4" event={"ID":"0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae","Type":"ContainerStarted","Data":"42fc1dd0d87dd5d18eb5fe9f33c91a8a8ba54c27aef75ff9f085c54e06a8b852"} Jul 21 17:26:53.873576 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:53.873338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:53.873760 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:53.873527 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:26:53.873760 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:53.873706 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls podName:bc1c7421-626d-4e71-acc4-e73e924995dd nodeName:}" failed. No retries permitted until 2026-07-21 17:26:55.873687455 +0000 UTC m=+40.059692313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls") pod "dns-default-z57wh" (UID: "bc1c7421-626d-4e71-acc4-e73e924995dd") : secret "dns-default-metrics-tls" not found Jul 21 17:26:54.655243 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:54.655210 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" event={"ID":"5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2","Type":"ContainerStarted","Data":"7fa1420f55f676fa0456a614e6c30312eb49f9b092ffa1d5df4380c613086f2d"} Jul 21 17:26:54.683139 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:54.683023 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fj2lp" podStartSLOduration=7.8268692600000005 podStartE2EDuration="37.683000981s" totalImagesPullingTime="29.856131721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:54.682701959 +0000 UTC m=+38.868706838" watchObservedRunningTime="2026-07-21 17:26:54.683000981 +0000 UTC m=+38.869005863" Jul 21 17:26:55.658623 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:55.658585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5c9w4" event={"ID":"0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae","Type":"ContainerStarted","Data":"698bf059d62123129b8a27f290e799a8d07e956a771dd035de145bba9c4f6029"} Jul 21 17:26:55.676175 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:55.676129 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5c9w4" podStartSLOduration=1.242329076 podStartE2EDuration="3.67611513s" totalImagesPullingTime="2.433786054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:55.675714459 +0000 UTC m=+39.861719342" watchObservedRunningTime="2026-07-21 17:26:55.67611513 +0000 UTC m=+39.862120010" Jul 21 17:26:55.890574 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:55.890533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:55.890774 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:55.890706 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:26:55.890845 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:55.890784 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls podName:bc1c7421-626d-4e71-acc4-e73e924995dd nodeName:}" failed. No retries permitted until 2026-07-21 17:26:59.890763391 +0000 UTC m=+44.076768251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls") pod "dns-default-z57wh" (UID: "bc1c7421-626d-4e71-acc4-e73e924995dd") : secret "dns-default-metrics-tls" not found Jul 21 17:26:57.094247 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.094206 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf"] Jul 21 17:26:57.126109 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.126080 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w7g9f"] Jul 21 17:26:57.126277 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.126257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" Jul 21 17:26:57.150264 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.150238 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf"] Jul 21 17:26:57.150372 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.150329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.173892 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.173866 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7g9f"] Jul 21 17:26:57.176427 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.176407 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 17:26:57.176963 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.176947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2qswg\"" Jul 21 17:26:57.177023 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.176951 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 17:26:57.184455 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.184438 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 17:26:57.184863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.184850 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 17:26:57.185443 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.185428 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lt4qw\"" Jul 21 17:26:57.185980 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.185966 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 21 17:26:57.186511 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.186500 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 21 17:26:57.299352 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.299308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec8cf908-3744-490c-b09e-b61158bbcb8b-data-volume\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.299506 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.299354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.299506 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.299430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89wfg\" (UniqueName: \"kubernetes.io/projected/e42ebdff-c5c5-4ff4-aaaf-babe31f300f6-kube-api-access-89wfg\") pod \"migrator-7cc9c7ffd7-96bzf\" (UID: \"e42ebdff-c5c5-4ff4-aaaf-babe31f300f6\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" Jul 21 17:26:57.299506 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.299468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcz9t\" (UniqueName: \"kubernetes.io/projected/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-api-access-vcz9t\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.299656 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.299517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec8cf908-3744-490c-b09e-b61158bbcb8b-crio-socket\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.299656 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.299534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.400921 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.400856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec8cf908-3744-490c-b09e-b61158bbcb8b-crio-socket\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.400921 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.400889 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.400921 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.400923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec8cf908-3744-490c-b09e-b61158bbcb8b-data-volume\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.401096 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.400940 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.401096 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.400986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89wfg\" (UniqueName: \"kubernetes.io/projected/e42ebdff-c5c5-4ff4-aaaf-babe31f300f6-kube-api-access-89wfg\") pod \"migrator-7cc9c7ffd7-96bzf\" (UID: \"e42ebdff-c5c5-4ff4-aaaf-babe31f300f6\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" Jul 21 17:26:57.401096 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.401006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcz9t\" (UniqueName: \"kubernetes.io/projected/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-api-access-vcz9t\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.401096 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:57.401008 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 17:26:57.401096 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.401080 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec8cf908-3744-490c-b09e-b61158bbcb8b-crio-socket\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.401096 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:57.401094 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm podName:ec8cf908-3744-490c-b09e-b61158bbcb8b nodeName:}" failed. No retries permitted until 2026-07-21 17:26:57.90107272 +0000 UTC m=+42.087077607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7g9f" (UID: "ec8cf908-3744-490c-b09e-b61158bbcb8b") : configmap "kube-rbac-proxy" not found Jul 21 17:26:57.401288 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:57.401118 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:26:57.401288 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:57.401177 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls podName:ec8cf908-3744-490c-b09e-b61158bbcb8b nodeName:}" failed. No retries permitted until 2026-07-21 17:26:57.901161273 +0000 UTC m=+42.087166136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7g9f" (UID: "ec8cf908-3744-490c-b09e-b61158bbcb8b") : secret "insights-runtime-extractor-tls" not found Jul 21 17:26:57.401288 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.401237 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec8cf908-3744-490c-b09e-b61158bbcb8b-data-volume\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.411117 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.411089 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcz9t\" (UniqueName: \"kubernetes.io/projected/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-api-access-vcz9t\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.411224 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.411092 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89wfg\" (UniqueName: \"kubernetes.io/projected/e42ebdff-c5c5-4ff4-aaaf-babe31f300f6-kube-api-access-89wfg\") pod \"migrator-7cc9c7ffd7-96bzf\" (UID: \"e42ebdff-c5c5-4ff4-aaaf-babe31f300f6\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" Jul 21 17:26:57.435813 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.435788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" Jul 21 17:26:57.582193 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.579871 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf"] Jul 21 17:26:57.583583 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:26:57.583542 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42ebdff_c5c5_4ff4_aaaf_babe31f300f6.slice/crio-4e5ad6c0106b76a7086569e53b91edbc329f4e96178db6c2a73e806848d8342a WatchSource:0}: Error finding container 4e5ad6c0106b76a7086569e53b91edbc329f4e96178db6c2a73e806848d8342a: Status 404 returned error can't find the container with id 4e5ad6c0106b76a7086569e53b91edbc329f4e96178db6c2a73e806848d8342a Jul 21 17:26:57.664324 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.664214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" event={"ID":"e42ebdff-c5c5-4ff4-aaaf-babe31f300f6","Type":"ContainerStarted","Data":"4e5ad6c0106b76a7086569e53b91edbc329f4e96178db6c2a73e806848d8342a"} Jul 21 17:26:57.905168 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.905125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.905332 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:57.905196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:57.905332 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:57.905253 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 17:26:57.905332 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:57.905315 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:26:57.905332 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:57.905327 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm podName:ec8cf908-3744-490c-b09e-b61158bbcb8b nodeName:}" failed. No retries permitted until 2026-07-21 17:26:58.905309381 +0000 UTC m=+43.091314252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7g9f" (UID: "ec8cf908-3744-490c-b09e-b61158bbcb8b") : configmap "kube-rbac-proxy" not found Jul 21 17:26:57.905508 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:57.905367 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls podName:ec8cf908-3744-490c-b09e-b61158bbcb8b nodeName:}" failed. No retries permitted until 2026-07-21 17:26:58.905350361 +0000 UTC m=+43.091355221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7g9f" (UID: "ec8cf908-3744-490c-b09e-b61158bbcb8b") : secret "insights-runtime-extractor-tls" not found Jul 21 17:26:58.912127 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:58.912084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:58.912661 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:58.912165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:26:58.912661 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:58.912238 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 17:26:58.912661 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:58.912266 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:26:58.912661 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:58.912292 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm podName:ec8cf908-3744-490c-b09e-b61158bbcb8b nodeName:}" failed. No retries permitted until 2026-07-21 17:27:00.912278491 +0000 UTC m=+45.098283349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7g9f" (UID: "ec8cf908-3744-490c-b09e-b61158bbcb8b") : configmap "kube-rbac-proxy" not found Jul 21 17:26:58.912661 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:58.912331 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls podName:ec8cf908-3744-490c-b09e-b61158bbcb8b nodeName:}" failed. No retries permitted until 2026-07-21 17:27:00.912312057 +0000 UTC m=+45.098316914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7g9f" (UID: "ec8cf908-3744-490c-b09e-b61158bbcb8b") : secret "insights-runtime-extractor-tls" not found Jul 21 17:26:59.714135 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:59.714118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9db6r_e5f53e19-4316-4c8c-a739-8d65012a31da/dns-node-resolver/0.log" Jul 21 17:26:59.919821 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:26:59.919745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:26:59.920145 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:59.919904 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 17:26:59.920145 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:26:59.919969 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls podName:bc1c7421-626d-4e71-acc4-e73e924995dd nodeName:}" failed. No retries permitted until 2026-07-21 17:27:07.919953385 +0000 UTC m=+52.105958243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls") pod "dns-default-z57wh" (UID: "bc1c7421-626d-4e71-acc4-e73e924995dd") : secret "dns-default-metrics-tls" not found Jul 21 17:27:00.672904 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.672866 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" event={"ID":"e42ebdff-c5c5-4ff4-aaaf-babe31f300f6","Type":"ContainerStarted","Data":"d595797778cecd5ffa036056e12e1f41a132c9262bb1ca905bf470a479d01be5"} Jul 21 17:27:00.673051 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.672917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" event={"ID":"e42ebdff-c5c5-4ff4-aaaf-babe31f300f6","Type":"ContainerStarted","Data":"4b9fbacad76d856e0ff180fa7b0e643240b43b68205f93f89ab9a49c327be092"} Jul 21 17:27:00.690317 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.690256 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-96bzf" podStartSLOduration=1.6315981229999998 podStartE2EDuration="3.690232698s" totalImagesPullingTime="2.058634575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:00.689956778 +0000 UTC m=+44.875961667" watchObservedRunningTime="2026-07-21 17:27:00.690232698 +0000 UTC m=+44.876237579" Jul 21 17:27:00.721185 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.721162 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gcz99_5e720559-add7-418c-aa6f-4a501dd40de3/node-ca/0.log" Jul 21 17:27:00.767025 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.766996 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-c87wt"] Jul 21 17:27:00.801689 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.801656 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-c87wt"] Jul 21 17:27:00.801808 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.801749 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:00.804739 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.804715 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 21 17:27:00.804877 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.804791 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 21 17:27:00.804877 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.804865 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zlh4m\"" Jul 21 17:27:00.804982 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.804921 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 21 17:27:00.804982 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.804922 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 21 17:27:00.929175 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.929095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc0f2747-50d8-4de2-ae96-d35647f0f05c-signing-cabundle\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:00.929175 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.929133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc0f2747-50d8-4de2-ae96-d35647f0f05c-signing-key\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:00.929585 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.929217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:27:00.929585 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.929266 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d847j\" (UniqueName: \"kubernetes.io/projected/fc0f2747-50d8-4de2-ae96-d35647f0f05c-kube-api-access-d847j\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:00.929585 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.929298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:27:00.929585 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:27:00.929408 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:27:00.929585 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:27:00.929476 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls podName:ec8cf908-3744-490c-b09e-b61158bbcb8b nodeName:}" failed. No retries permitted until 2026-07-21 17:27:04.929457215 +0000 UTC m=+49.115462089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7g9f" (UID: "ec8cf908-3744-490c-b09e-b61158bbcb8b") : secret "insights-runtime-extractor-tls" not found Jul 21 17:27:00.929914 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:00.929895 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec8cf908-3744-490c-b09e-b61158bbcb8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:27:01.029866 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.029828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d847j\" (UniqueName: \"kubernetes.io/projected/fc0f2747-50d8-4de2-ae96-d35647f0f05c-kube-api-access-d847j\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:01.030054 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.029923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc0f2747-50d8-4de2-ae96-d35647f0f05c-signing-cabundle\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:01.030054 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.029960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc0f2747-50d8-4de2-ae96-d35647f0f05c-signing-key\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:01.030667 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.030643 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc0f2747-50d8-4de2-ae96-d35647f0f05c-signing-cabundle\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:01.033317 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.033293 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc0f2747-50d8-4de2-ae96-d35647f0f05c-signing-key\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:01.038482 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.038462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d847j\" (UniqueName: \"kubernetes.io/projected/fc0f2747-50d8-4de2-ae96-d35647f0f05c-kube-api-access-d847j\") pod \"service-ca-58598695f7-c87wt\" (UID: \"fc0f2747-50d8-4de2-ae96-d35647f0f05c\") " pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:01.109988 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.109949 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-c87wt" Jul 21 17:27:01.269390 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.269094 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-c87wt"] Jul 21 17:27:01.272454 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:01.272421 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0f2747_50d8_4de2_ae96_d35647f0f05c.slice/crio-4809bca4bb4b9e6e2cb0cdbd020762a17a279a563a5dfda12f9c0a6233048f6a WatchSource:0}: Error finding container 4809bca4bb4b9e6e2cb0cdbd020762a17a279a563a5dfda12f9c0a6233048f6a: Status 404 returned error can't find the container with id 4809bca4bb4b9e6e2cb0cdbd020762a17a279a563a5dfda12f9c0a6233048f6a Jul 21 17:27:01.514596 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.514503 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5c9w4_0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae/serve-healthcheck-canary/0.log" Jul 21 17:27:01.676051 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:01.676016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-c87wt" event={"ID":"fc0f2747-50d8-4de2-ae96-d35647f0f05c","Type":"ContainerStarted","Data":"4809bca4bb4b9e6e2cb0cdbd020762a17a279a563a5dfda12f9c0a6233048f6a"} Jul 21 17:27:02.114878 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:02.114850 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-96bzf_e42ebdff-c5c5-4ff4-aaaf-babe31f300f6/migrator/0.log" Jul 21 17:27:02.314772 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:02.314740 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-96bzf_e42ebdff-c5c5-4ff4-aaaf-babe31f300f6/graceful-termination/0.log" Jul 21 17:27:04.685619 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:04.685590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-c87wt" event={"ID":"fc0f2747-50d8-4de2-ae96-d35647f0f05c","Type":"ContainerStarted","Data":"d6c9a5d2258f117d5016f4621694f16dc78d08880cb8cb334207383eb139a5c7"} Jul 21 17:27:04.704054 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:04.703998 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-c87wt" podStartSLOduration=2.367013591 podStartE2EDuration="4.703979921s" totalImagesPullingTime="2.33696633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:04.703154158 +0000 UTC m=+48.889159039" watchObservedRunningTime="2026-07-21 17:27:04.703979921 +0000 UTC m=+48.889984802" Jul 21 17:27:04.966037 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:04.965992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:27:04.966229 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:27:04.966133 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 17:27:04.966229 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:27:04.966218 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls podName:ec8cf908-3744-490c-b09e-b61158bbcb8b nodeName:}" failed. No retries permitted until 2026-07-21 17:27:12.96619934 +0000 UTC m=+57.152204211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7g9f" (UID: "ec8cf908-3744-490c-b09e-b61158bbcb8b") : secret "insights-runtime-extractor-tls" not found Jul 21 17:27:07.990936 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:07.990896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:27:07.993540 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:07.993510 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1c7421-626d-4e71-acc4-e73e924995dd-metrics-tls\") pod \"dns-default-z57wh\" (UID: \"bc1c7421-626d-4e71-acc4-e73e924995dd\") " pod="openshift-dns/dns-default-z57wh" Jul 21 17:27:08.081734 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:08.081700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z57wh" Jul 21 17:27:08.224823 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:08.224794 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z57wh"] Jul 21 17:27:08.228205 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:08.228176 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1c7421_626d_4e71_acc4_e73e924995dd.slice/crio-063dc4e9bcada0f7ddeb4740a2f30bfd20f3a38c18c899c5da0ccf5063336b01 WatchSource:0}: Error finding container 063dc4e9bcada0f7ddeb4740a2f30bfd20f3a38c18c899c5da0ccf5063336b01: Status 404 returned error can't find the container with id 063dc4e9bcada0f7ddeb4740a2f30bfd20f3a38c18c899c5da0ccf5063336b01 Jul 21 17:27:08.697541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:08.697505 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z57wh" event={"ID":"bc1c7421-626d-4e71-acc4-e73e924995dd","Type":"ContainerStarted","Data":"063dc4e9bcada0f7ddeb4740a2f30bfd20f3a38c18c899c5da0ccf5063336b01"} Jul 21 17:27:10.705479 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:10.705444 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z57wh" event={"ID":"bc1c7421-626d-4e71-acc4-e73e924995dd","Type":"ContainerStarted","Data":"b8ba74867553cd57dc998573c5ba80d235684a04f9a328c2b0f182c2ff8d7ec9"} Jul 21 17:27:10.705942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:10.705503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z57wh" event={"ID":"bc1c7421-626d-4e71-acc4-e73e924995dd","Type":"ContainerStarted","Data":"da9d5c5d44cb27b59d4e85dacce294cfdefb754d76be7b816f68b10be370cac8"} Jul 21 17:27:10.705942 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:10.705599 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z57wh" Jul 21 17:27:10.727970 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:10.727911 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z57wh" podStartSLOduration=16.846429454 podStartE2EDuration="18.727891382s" totalImagesPullingTime="1.881461928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:10.726131375 +0000 UTC m=+54.912136265" watchObservedRunningTime="2026-07-21 17:27:10.727891382 +0000 UTC m=+54.913896257" Jul 21 17:27:13.021766 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:13.021705 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:27:13.024103 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:13.024072 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec8cf908-3744-490c-b09e-b61158bbcb8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7g9f\" (UID: \"ec8cf908-3744-490c-b09e-b61158bbcb8b\") " pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:27:13.058264 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:13.058236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7g9f" Jul 21 17:27:13.190422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:13.190386 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7g9f"] Jul 21 17:27:13.194067 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:13.194041 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8cf908_3744_490c_b09e_b61158bbcb8b.slice/crio-1f51ec34c6a27fc17dfa6660d42b31b49beb79cf363e921d5df1b39e192e8281 WatchSource:0}: Error finding container 1f51ec34c6a27fc17dfa6660d42b31b49beb79cf363e921d5df1b39e192e8281: Status 404 returned error can't find the container with id 1f51ec34c6a27fc17dfa6660d42b31b49beb79cf363e921d5df1b39e192e8281 Jul 21 17:27:13.719988 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:13.719949 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7g9f" event={"ID":"ec8cf908-3744-490c-b09e-b61158bbcb8b","Type":"ContainerStarted","Data":"1f51ec34c6a27fc17dfa6660d42b31b49beb79cf363e921d5df1b39e192e8281"} Jul 21 17:27:18.637856 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:18.637780 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hf7wc" Jul 21 17:27:18.740647 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:18.740615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7g9f" event={"ID":"ec8cf908-3744-490c-b09e-b61158bbcb8b","Type":"ContainerStarted","Data":"08421007486d2993a64dc8d8eb7578bccc7624a2b20488bc914e59f822e1eac3"} Jul 21 17:27:20.714050 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:20.714018 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z57wh" Jul 21 17:27:21.994652 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:21.994615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:27:21.997450 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:21.997428 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 17:27:22.008003 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.007980 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7b623b7-e33c-4b70-9582-362854fe68aa-original-pull-secret\") pod \"global-pull-secret-syncer-fzpvb\" (UID: \"d7b623b7-e33c-4b70-9582-362854fe68aa\") " pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:27:22.067094 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.067014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzpvb" Jul 21 17:27:22.095081 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.095046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:27:22.095255 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.095092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:27:22.097725 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.097706 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 17:27:22.097846 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.097737 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 17:27:22.107950 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.107915 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c06dd5-82f6-44e4-9470-07d3566635b6-metrics-certs\") pod \"network-metrics-daemon-pxxk4\" (UID: \"82c06dd5-82f6-44e4-9470-07d3566635b6\") " pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:27:22.108089 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.108021 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 17:27:22.119386 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.119099 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtbnt\" (UniqueName: \"kubernetes.io/projected/5e8db8b1-4276-4eaa-923b-dc316b87f016-kube-api-access-rtbnt\") pod \"network-check-target-57xw5\" (UID: \"5e8db8b1-4276-4eaa-923b-dc316b87f016\") " pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:27:22.200526 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.200499 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzpvb"] Jul 21 17:27:22.204767 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:22.204723 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b623b7_e33c_4b70_9582_362854fe68aa.slice/crio-671430ad2c40b5b6c5fdecc953bc087951b2b697241e9086b5a12fda130d2e3d WatchSource:0}: Error finding container 671430ad2c40b5b6c5fdecc953bc087951b2b697241e9086b5a12fda130d2e3d: Status 404 returned error can't find the container with id 671430ad2c40b5b6c5fdecc953bc087951b2b697241e9086b5a12fda130d2e3d Jul 21 17:27:22.408056 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.407983 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sfsp8\"" Jul 21 17:27:22.412060 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.412035 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9vqxq\"" Jul 21 17:27:22.415119 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.415099 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pxxk4" Jul 21 17:27:22.418346 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.418323 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:27:22.600326 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.600298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pxxk4"] Jul 21 17:27:22.601360 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:22.601336 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c06dd5_82f6_44e4_9470_07d3566635b6.slice/crio-abfe648d9b9416f212a5d74283a24790d9b645fd6425e94939df988b4f007f67 WatchSource:0}: Error finding container abfe648d9b9416f212a5d74283a24790d9b645fd6425e94939df988b4f007f67: Status 404 returned error can't find the container with id abfe648d9b9416f212a5d74283a24790d9b645fd6425e94939df988b4f007f67 Jul 21 17:27:22.612572 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.612526 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-57xw5"] Jul 21 17:27:22.616181 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:22.616156 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8db8b1_4276_4eaa_923b_dc316b87f016.slice/crio-fcd9f398495950ceefdf66ece23de1d3cc509a0a5ddae61329dbfda0e2ac21ce WatchSource:0}: Error finding container fcd9f398495950ceefdf66ece23de1d3cc509a0a5ddae61329dbfda0e2ac21ce: Status 404 returned error can't find the container with id fcd9f398495950ceefdf66ece23de1d3cc509a0a5ddae61329dbfda0e2ac21ce Jul 21 17:27:22.759633 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.759584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pxxk4" event={"ID":"82c06dd5-82f6-44e4-9470-07d3566635b6","Type":"ContainerStarted","Data":"abfe648d9b9416f212a5d74283a24790d9b645fd6425e94939df988b4f007f67"} Jul 21 17:27:22.760903 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.760870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzpvb" event={"ID":"d7b623b7-e33c-4b70-9582-362854fe68aa","Type":"ContainerStarted","Data":"671430ad2c40b5b6c5fdecc953bc087951b2b697241e9086b5a12fda130d2e3d"} Jul 21 17:27:22.762836 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.762807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7g9f" event={"ID":"ec8cf908-3744-490c-b09e-b61158bbcb8b","Type":"ContainerStarted","Data":"567c45db7846fb71cf5e80069b53b06ecd94ea52bd46971c83ad86d7c521119b"} Jul 21 17:27:22.764088 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:22.764062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-57xw5" event={"ID":"5e8db8b1-4276-4eaa-923b-dc316b87f016","Type":"ContainerStarted","Data":"fcd9f398495950ceefdf66ece23de1d3cc509a0a5ddae61329dbfda0e2ac21ce"} Jul 21 17:27:24.778335 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:24.778296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pxxk4" event={"ID":"82c06dd5-82f6-44e4-9470-07d3566635b6","Type":"ContainerStarted","Data":"dd04b5da234fb04913968cfb2d0ee02fcf9e36bcac194027f01ab57f165cd067"} Jul 21 17:27:26.123203 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.123168 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8"] Jul 21 17:27:26.126109 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.126084 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" Jul 21 17:27:26.130326 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.130298 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 21 17:27:26.130477 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.130464 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 17:27:26.130549 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.130505 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 17:27:26.130549 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.130505 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 17:27:26.131728 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.131702 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sgzsb\"" Jul 21 17:27:26.148504 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.148478 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8"] Jul 21 17:27:26.228602 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.228506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1d67e9d-0f92-4fbe-8cbf-81ade114c168-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-798cdfd666-79pk8\" (UID: \"c1d67e9d-0f92-4fbe-8cbf-81ade114c168\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" Jul 21 17:27:26.228602 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.228598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f7p8\" (UniqueName: \"kubernetes.io/projected/c1d67e9d-0f92-4fbe-8cbf-81ade114c168-kube-api-access-8f7p8\") pod \"managed-serviceaccount-addon-agent-798cdfd666-79pk8\" (UID: \"c1d67e9d-0f92-4fbe-8cbf-81ade114c168\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" Jul 21 17:27:26.239767 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.239731 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8"] Jul 21 17:27:26.241854 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.241823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" Jul 21 17:27:26.246595 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.245655 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4kmf7\"" Jul 21 17:27:26.246595 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.245714 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 21 17:27:26.246595 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.246110 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 21 17:27:26.246967 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.246947 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64f8d6c587-nwnmb"] Jul 21 17:27:26.248936 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.248913 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.251720 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.251695 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 17:27:26.252069 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.252044 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 17:27:26.253598 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.252152 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 17:27:26.253598 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.252169 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bwwcr\"" Jul 21 17:27:26.256936 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.256904 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8"] Jul 21 17:27:26.260776 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.260594 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 17:27:26.280970 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.280943 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64f8d6c587-nwnmb"] Jul 21 17:27:26.329349 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f150b36-5893-42a7-bc00-3d13184916c8-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zrfq8\" (UID: \"4f150b36-5893-42a7-bc00-3d13184916c8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" Jul 21 17:27:26.329537 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f7p8\" (UniqueName: \"kubernetes.io/projected/c1d67e9d-0f92-4fbe-8cbf-81ade114c168-kube-api-access-8f7p8\") pod \"managed-serviceaccount-addon-agent-798cdfd666-79pk8\" (UID: \"c1d67e9d-0f92-4fbe-8cbf-81ade114c168\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" Jul 21 17:27:26.329537 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3114e58c-7310-40a3-8ac1-d88648e22f95-installation-pull-secrets\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.329537 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw7c2\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-kube-api-access-xw7c2\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.329537 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-bound-sa-token\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.329788 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3114e58c-7310-40a3-8ac1-d88648e22f95-registry-certificates\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.329788 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329577 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3114e58c-7310-40a3-8ac1-d88648e22f95-ca-trust-extracted\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.329788 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329599 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3114e58c-7310-40a3-8ac1-d88648e22f95-image-registry-private-configuration\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.329788 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1d67e9d-0f92-4fbe-8cbf-81ade114c168-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-798cdfd666-79pk8\" (UID: \"c1d67e9d-0f92-4fbe-8cbf-81ade114c168\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" Jul 21 17:27:26.329788 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f150b36-5893-42a7-bc00-3d13184916c8-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrfq8\" (UID: \"4f150b36-5893-42a7-bc00-3d13184916c8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" Jul 21 17:27:26.329788 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-registry-tls\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.329788 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.329739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3114e58c-7310-40a3-8ac1-d88648e22f95-trusted-ca\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.332693 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.332666 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1d67e9d-0f92-4fbe-8cbf-81ade114c168-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-798cdfd666-79pk8\" (UID: \"c1d67e9d-0f92-4fbe-8cbf-81ade114c168\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" Jul 21 17:27:26.340498 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.340476 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f7p8\" (UniqueName: \"kubernetes.io/projected/c1d67e9d-0f92-4fbe-8cbf-81ade114c168-kube-api-access-8f7p8\") pod \"managed-serviceaccount-addon-agent-798cdfd666-79pk8\" (UID: \"c1d67e9d-0f92-4fbe-8cbf-81ade114c168\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" Jul 21 17:27:26.430775 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.430738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3114e58c-7310-40a3-8ac1-d88648e22f95-image-registry-private-configuration\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.430958 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.430789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f150b36-5893-42a7-bc00-3d13184916c8-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrfq8\" (UID: \"4f150b36-5893-42a7-bc00-3d13184916c8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" Jul 21 17:27:26.430958 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.430819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-registry-tls\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.430958 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.430838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3114e58c-7310-40a3-8ac1-d88648e22f95-trusted-ca\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.430958 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.430869 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f150b36-5893-42a7-bc00-3d13184916c8-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zrfq8\" (UID: \"4f150b36-5893-42a7-bc00-3d13184916c8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" Jul 21 17:27:26.430958 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.430900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3114e58c-7310-40a3-8ac1-d88648e22f95-installation-pull-secrets\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.430958 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.430920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw7c2\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-kube-api-access-xw7c2\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.431268 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.430969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-bound-sa-token\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.431268 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.431001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3114e58c-7310-40a3-8ac1-d88648e22f95-registry-certificates\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.431268 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.431024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3114e58c-7310-40a3-8ac1-d88648e22f95-ca-trust-extracted\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.431413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.431366 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3114e58c-7310-40a3-8ac1-d88648e22f95-ca-trust-extracted\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.431934 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.431910 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f150b36-5893-42a7-bc00-3d13184916c8-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zrfq8\" (UID: \"4f150b36-5893-42a7-bc00-3d13184916c8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" Jul 21 17:27:26.432141 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.432116 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3114e58c-7310-40a3-8ac1-d88648e22f95-trusted-ca\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.432475 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.432450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3114e58c-7310-40a3-8ac1-d88648e22f95-registry-certificates\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.433831 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.433803 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3114e58c-7310-40a3-8ac1-d88648e22f95-installation-pull-secrets\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.433968 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.433948 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f150b36-5893-42a7-bc00-3d13184916c8-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zrfq8\" (UID: \"4f150b36-5893-42a7-bc00-3d13184916c8\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" Jul 21 17:27:26.434036 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.433950 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3114e58c-7310-40a3-8ac1-d88648e22f95-image-registry-private-configuration\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.434388 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.434364 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-registry-tls\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.444418 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.444392 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-bound-sa-token\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.444890 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.444873 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw7c2\" (UniqueName: \"kubernetes.io/projected/3114e58c-7310-40a3-8ac1-d88648e22f95-kube-api-access-xw7c2\") pod \"image-registry-64f8d6c587-nwnmb\" (UID: \"3114e58c-7310-40a3-8ac1-d88648e22f95\") " pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:26.452235 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.452214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" Jul 21 17:27:26.555286 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.555193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" Jul 21 17:27:26.563378 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:26.563352 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:28.587654 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.587495 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8"] Jul 21 17:27:28.610849 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.610814 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8"] Jul 21 17:27:28.613968 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:28.613946 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1d67e9d_0f92_4fbe_8cbf_81ade114c168.slice/crio-66f2ca4530249ed194b885812d055272d72d8fbf9b4ac9460a08f9d196440507 WatchSource:0}: Error finding container 66f2ca4530249ed194b885812d055272d72d8fbf9b4ac9460a08f9d196440507: Status 404 returned error can't find the container with id 66f2ca4530249ed194b885812d055272d72d8fbf9b4ac9460a08f9d196440507 Jul 21 17:27:28.638346 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.638284 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64f8d6c587-nwnmb"] Jul 21 17:27:28.642065 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:28.642035 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3114e58c_7310_40a3_8ac1_d88648e22f95.slice/crio-dd6f7cd44685d119b3f0df1543fe6c3d3fb50e39d59d3dcb206f7f906f0ce626 WatchSource:0}: Error finding container dd6f7cd44685d119b3f0df1543fe6c3d3fb50e39d59d3dcb206f7f906f0ce626: Status 404 returned error can't find the container with id dd6f7cd44685d119b3f0df1543fe6c3d3fb50e39d59d3dcb206f7f906f0ce626 Jul 21 17:27:28.681879 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.681853 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz"] Jul 21 17:27:28.688951 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.688929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" Jul 21 17:27:28.691568 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.691518 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 21 17:27:28.691861 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.691842 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jt2vn\"" Jul 21 17:27:28.701117 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.700279 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz"] Jul 21 17:27:28.751671 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.751633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eeed0d25-75fc-4367-aa35-ba8618b3d454-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-h29bz\" (UID: \"eeed0d25-75fc-4367-aa35-ba8618b3d454\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" Jul 21 17:27:28.793864 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.793825 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7g9f" event={"ID":"ec8cf908-3744-490c-b09e-b61158bbcb8b","Type":"ContainerStarted","Data":"3df78f76d0de506c5c33514c1e3c371028fb354c3fa70de320986356e2fa25a8"} Jul 21 17:27:28.795536 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.795504 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-57xw5" event={"ID":"5e8db8b1-4276-4eaa-923b-dc316b87f016","Type":"ContainerStarted","Data":"4ef7f50db7fddb33546b3954a88bdb175d4ac5c46945f170c1a34b0714effb74"} Jul 21 17:27:28.795697 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.795614 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:27:28.796728 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.796698 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" event={"ID":"4f150b36-5893-42a7-bc00-3d13184916c8","Type":"ContainerStarted","Data":"b44a9c97b6589129db7ca1c19f153cdfba41506eb83bba507236e8eb17a3e145"} Jul 21 17:27:28.798764 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.798738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pxxk4" event={"ID":"82c06dd5-82f6-44e4-9470-07d3566635b6","Type":"ContainerStarted","Data":"a9dfa489c27cbe0e546ebb7c3f6b8d245fc27f39a4e391a2b017237d18bfbdec"} Jul 21 17:27:28.800304 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.800278 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" event={"ID":"3114e58c-7310-40a3-8ac1-d88648e22f95","Type":"ContainerStarted","Data":"4a022f07772291c444fab6c9395dac3df5af3ad54cba6512fe8ec7f644e51aff"} Jul 21 17:27:28.800433 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.800316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" event={"ID":"3114e58c-7310-40a3-8ac1-d88648e22f95","Type":"ContainerStarted","Data":"dd6f7cd44685d119b3f0df1543fe6c3d3fb50e39d59d3dcb206f7f906f0ce626"} Jul 21 17:27:28.800433 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.800362 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:28.801843 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.801821 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzpvb" event={"ID":"d7b623b7-e33c-4b70-9582-362854fe68aa","Type":"ContainerStarted","Data":"c99df813c7b154e594fba9822b73747cc9d01975f489407b46b0e9a0913af84e"} Jul 21 17:27:28.803086 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.803057 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" event={"ID":"c1d67e9d-0f92-4fbe-8cbf-81ade114c168","Type":"ContainerStarted","Data":"66f2ca4530249ed194b885812d055272d72d8fbf9b4ac9460a08f9d196440507"} Jul 21 17:27:28.815214 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.815168 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w7g9f" podStartSLOduration=16.71328561 podStartE2EDuration="31.815152845s" totalImagesPullingTime="15.101867235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:28.814397986 +0000 UTC m=+73.000402863" watchObservedRunningTime="2026-07-21 17:27:28.815152845 +0000 UTC m=+73.001157724" Jul 21 17:27:28.839386 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.839276 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" podStartSLOduration=2.83926164 podStartE2EDuration="2.83926164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:28.83815519 +0000 UTC m=+73.024160070" watchObservedRunningTime="2026-07-21 17:27:28.83926164 +0000 UTC m=+73.025266497" Jul 21 17:27:28.852194 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.852164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eeed0d25-75fc-4367-aa35-ba8618b3d454-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-h29bz\" (UID: \"eeed0d25-75fc-4367-aa35-ba8618b3d454\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" Jul 21 17:27:28.852356 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:27:28.852327 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 21 17:27:28.852452 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:27:28.852421 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeed0d25-75fc-4367-aa35-ba8618b3d454-tls-certificates podName:eeed0d25-75fc-4367-aa35-ba8618b3d454 nodeName:}" failed. No retries permitted until 2026-07-21 17:27:29.352397698 +0000 UTC m=+73.538402562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/eeed0d25-75fc-4367-aa35-ba8618b3d454-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-h29bz" (UID: "eeed0d25-75fc-4367-aa35-ba8618b3d454") : secret "prometheus-operator-admission-webhook-tls" not found Jul 21 17:27:28.859491 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.859438 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pxxk4" podStartSLOduration=70.586340641 podStartE2EDuration="1m11.859423003s" totalImagesPullingTime="1.273082362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:28.858261748 +0000 UTC m=+73.044266629" watchObservedRunningTime="2026-07-21 17:27:28.859423003 +0000 UTC m=+73.045427883" Jul 21 17:27:28.876459 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.876400 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fzpvb" podStartSLOduration=65.673380876 podStartE2EDuration="1m11.8763865s" totalImagesPullingTime="6.203005624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:28.875405373 +0000 UTC m=+73.061410253" watchObservedRunningTime="2026-07-21 17:27:28.8763865 +0000 UTC m=+73.062391381" Jul 21 17:27:28.894133 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:28.894084 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-57xw5" podStartSLOduration=66.113309556 podStartE2EDuration="1m11.894068169s" totalImagesPullingTime="5.780758613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:28.892805212 +0000 UTC m=+73.078810092" watchObservedRunningTime="2026-07-21 17:27:28.894068169 +0000 UTC m=+73.080073088" Jul 21 17:27:29.357744 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:29.357706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eeed0d25-75fc-4367-aa35-ba8618b3d454-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-h29bz\" (UID: \"eeed0d25-75fc-4367-aa35-ba8618b3d454\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" Jul 21 17:27:29.360933 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:29.360898 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eeed0d25-75fc-4367-aa35-ba8618b3d454-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-h29bz\" (UID: \"eeed0d25-75fc-4367-aa35-ba8618b3d454\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" Jul 21 17:27:29.605757 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:29.605720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" Jul 21 17:27:31.124274 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:31.124247 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz"] Jul 21 17:27:31.127591 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:31.127565 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeed0d25_75fc_4367_aa35_ba8618b3d454.slice/crio-733aae5ac319ce0d5d7cb0850ad55a1208b35bfa5cf2296b976738a3081119b2 WatchSource:0}: Error finding container 733aae5ac319ce0d5d7cb0850ad55a1208b35bfa5cf2296b976738a3081119b2: Status 404 returned error can't find the container with id 733aae5ac319ce0d5d7cb0850ad55a1208b35bfa5cf2296b976738a3081119b2 Jul 21 17:27:31.814975 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:31.814934 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" event={"ID":"4f150b36-5893-42a7-bc00-3d13184916c8","Type":"ContainerStarted","Data":"aefa4e371dd23c8919d8f282510f24254cd050e404593bf31df17c7fb8462766"} Jul 21 17:27:31.816503 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:31.816471 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" event={"ID":"c1d67e9d-0f92-4fbe-8cbf-81ade114c168","Type":"ContainerStarted","Data":"5a137d8d1a53686d4ff5e08e889a66f1178b78b573e05c8c3d0d1b1056eec645"} Jul 21 17:27:31.817709 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:31.817682 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" event={"ID":"eeed0d25-75fc-4367-aa35-ba8618b3d454","Type":"ContainerStarted","Data":"733aae5ac319ce0d5d7cb0850ad55a1208b35bfa5cf2296b976738a3081119b2"} Jul 21 17:27:31.832404 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:31.832348 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zrfq8" podStartSLOduration=3.433450475 podStartE2EDuration="5.832328535s" totalImagesPullingTime="2.39887806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:31.831268262 +0000 UTC m=+76.017273143" watchObservedRunningTime="2026-07-21 17:27:31.832328535 +0000 UTC m=+76.018333416" Jul 21 17:27:31.853873 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:31.853816 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-798cdfd666-79pk8" podStartSLOduration=3.418850236 podStartE2EDuration="5.85379607s" totalImagesPullingTime="2.434945834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:31.853614997 +0000 UTC m=+76.039619878" watchObservedRunningTime="2026-07-21 17:27:31.85379607 +0000 UTC m=+76.039800952" Jul 21 17:27:32.397222 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.397195 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cf7b75d75-42n5x"] Jul 21 17:27:32.400155 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.400138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.403000 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.402978 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 17:27:32.403119 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.403030 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 17:27:32.404058 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.404025 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 17:27:32.404058 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.404043 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 17:27:32.404233 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.404073 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9svqm\"" Jul 21 17:27:32.404233 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.404087 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 17:27:32.404233 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.404119 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 17:27:32.404380 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.404356 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 17:27:32.410594 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.410572 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf7b75d75-42n5x"] Jul 21 17:27:32.481272 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.481239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-867x2\" (UniqueName: \"kubernetes.io/projected/a6157007-9c7f-4972-9952-2999420c0816-kube-api-access-867x2\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.481419 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.481288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-oauth-config\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.481419 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.481365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-oauth-serving-cert\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.481419 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.481409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-serving-cert\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.481549 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.481448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-service-ca\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.481549 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.481470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-console-config\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.582627 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.582595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-service-ca\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.582627 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.582627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-console-config\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.582866 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.582646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-867x2\" (UniqueName: \"kubernetes.io/projected/a6157007-9c7f-4972-9952-2999420c0816-kube-api-access-867x2\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.582866 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.582678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-oauth-config\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.582866 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.582730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-oauth-serving-cert\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.582866 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.582768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-serving-cert\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.583351 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.583327 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-service-ca\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.583468 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.583441 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-console-config\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.583703 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.583683 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-oauth-serving-cert\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.585281 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.585254 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-oauth-config\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.585398 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.585256 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-serving-cert\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.591531 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.591511 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-867x2\" (UniqueName: \"kubernetes.io/projected/a6157007-9c7f-4972-9952-2999420c0816-kube-api-access-867x2\") pod \"console-cf7b75d75-42n5x\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.709079 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.709041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:32.824598 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.824539 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" event={"ID":"eeed0d25-75fc-4367-aa35-ba8618b3d454","Type":"ContainerStarted","Data":"ea911e8ef81f0f0b6afe179a2230e039498008469c3d90177160cdbf88eef892"} Jul 21 17:27:32.825233 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.824956 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" Jul 21 17:27:32.829349 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.829327 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" Jul 21 17:27:32.841147 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.841102 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-h29bz" podStartSLOduration=3.794701313 podStartE2EDuration="4.841085268s" totalImagesPullingTime="1.046383955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:32.840736473 +0000 UTC m=+77.026741354" watchObservedRunningTime="2026-07-21 17:27:32.841085268 +0000 UTC m=+77.027090149" Jul 21 17:27:32.845217 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:32.845196 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf7b75d75-42n5x"] Jul 21 17:27:32.848452 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:32.848430 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6157007_9c7f_4972_9952_2999420c0816.slice/crio-edc01819cef2cee9f6b416525eacec97b6312426cab209c48a1136e0f3714723 WatchSource:0}: Error finding container edc01819cef2cee9f6b416525eacec97b6312426cab209c48a1136e0f3714723: Status 404 returned error can't find the container with id edc01819cef2cee9f6b416525eacec97b6312426cab209c48a1136e0f3714723 Jul 21 17:27:33.830850 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:33.830814 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7b75d75-42n5x" event={"ID":"a6157007-9c7f-4972-9952-2999420c0816","Type":"ContainerStarted","Data":"edc01819cef2cee9f6b416525eacec97b6312426cab209c48a1136e0f3714723"} Jul 21 17:27:36.847296 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:36.847178 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7b75d75-42n5x" event={"ID":"a6157007-9c7f-4972-9952-2999420c0816","Type":"ContainerStarted","Data":"8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f"} Jul 21 17:27:36.873120 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:36.873076 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cf7b75d75-42n5x" podStartSLOduration=1.878765883 podStartE2EDuration="4.873060337s" totalImagesPullingTime="2.994294454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:36.870888705 +0000 UTC m=+81.056893586" watchObservedRunningTime="2026-07-21 17:27:36.873060337 +0000 UTC m=+81.059065216" Jul 21 17:27:38.519535 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.519501 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-g6f7l"] Jul 21 17:27:38.522806 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.522788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.529237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.529138 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 21 17:27:38.529738 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.529719 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 21 17:27:38.536120 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.536101 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 17:27:38.536186 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.536105 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b8qpx\"" Jul 21 17:27:38.536346 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.536324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 17:27:38.536615 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.536599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 21 17:27:38.536697 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.536684 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 17:27:38.567054 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.567015 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-g6f7l"] Jul 21 17:27:38.607130 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.607098 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qnf2s"] Jul 21 17:27:38.611792 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.611766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.615052 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.615027 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tzftz\"" Jul 21 17:27:38.615296 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.615281 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 17:27:38.615398 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.615382 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 17:27:38.615513 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.615496 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 17:27:38.632590 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.632544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94e4de6b-9099-4e65-8731-d9049564048c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.632716 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.632629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/94e4de6b-9099-4e65-8731-d9049564048c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.632716 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.632664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.632716 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.632680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qfgc\" (UniqueName: \"kubernetes.io/projected/94e4de6b-9099-4e65-8731-d9049564048c-kube-api-access-5qfgc\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.632831 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.632724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.632831 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.632755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.733433 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-sys\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.733433 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733432 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-tls\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.733690 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-root\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.733690 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.733690 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94e4de6b-9099-4e65-8731-d9049564048c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.733690 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733591 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ced24b5-5f05-456a-9daa-98ac981d4ced-metrics-client-ca\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.733690 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/94e4de6b-9099-4e65-8731-d9049564048c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.733690 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.733931 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qfgc\" (UniqueName: \"kubernetes.io/projected/94e4de6b-9099-4e65-8731-d9049564048c-kube-api-access-5qfgc\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.733931 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-wtmp\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.733931 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-textfile\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.733931 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.733931 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.733820 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.734160 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.734082 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/94e4de6b-9099-4e65-8731-d9049564048c-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.734160 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.734136 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-accelerators-collector-config\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.734259 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.734172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwzqs\" (UniqueName: \"kubernetes.io/projected/0ced24b5-5f05-456a-9daa-98ac981d4ced-kube-api-access-nwzqs\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.734414 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.734393 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94e4de6b-9099-4e65-8731-d9049564048c-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.734467 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.734399 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.736860 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.736837 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.736952 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.736878 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/94e4de6b-9099-4e65-8731-d9049564048c-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.748988 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.748953 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qfgc\" (UniqueName: \"kubernetes.io/projected/94e4de6b-9099-4e65-8731-d9049564048c-kube-api-access-5qfgc\") pod \"kube-state-metrics-56c5594674-g6f7l\" (UID: \"94e4de6b-9099-4e65-8731-d9049564048c\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.832643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.832539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" Jul 21 17:27:38.834871 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.834838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-accelerators-collector-config\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835012 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.834881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwzqs\" (UniqueName: \"kubernetes.io/projected/0ced24b5-5f05-456a-9daa-98ac981d4ced-kube-api-access-nwzqs\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835012 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.834909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-sys\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835012 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.834925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-tls\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835012 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.834951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-root\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835012 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.834979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835012 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ced24b5-5f05-456a-9daa-98ac981d4ced-metrics-client-ca\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835026 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-sys\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835033 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-root\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-wtmp\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-textfile\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835181 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-wtmp\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835465 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835446 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-textfile\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.835616 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835591 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-accelerators-collector-config\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.836298 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.835875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ced24b5-5f05-456a-9daa-98ac981d4ced-metrics-client-ca\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.837644 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.837614 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-tls\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.837850 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.837835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ced24b5-5f05-456a-9daa-98ac981d4ced-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.848869 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.848843 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwzqs\" (UniqueName: \"kubernetes.io/projected/0ced24b5-5f05-456a-9daa-98ac981d4ced-kube-api-access-nwzqs\") pod \"node-exporter-qnf2s\" (UID: \"0ced24b5-5f05-456a-9daa-98ac981d4ced\") " pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.922100 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.922070 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qnf2s" Jul 21 17:27:38.934185 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:38.934156 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ced24b5_5f05_456a_9daa_98ac981d4ced.slice/crio-f844f293166600d138a81de603a57ad2a9b1b07781b3a9ec2dea1e950165fa0e WatchSource:0}: Error finding container f844f293166600d138a81de603a57ad2a9b1b07781b3a9ec2dea1e950165fa0e: Status 404 returned error can't find the container with id f844f293166600d138a81de603a57ad2a9b1b07781b3a9ec2dea1e950165fa0e Jul 21 17:27:38.993606 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:38.993578 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-g6f7l"] Jul 21 17:27:38.996461 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:38.996434 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e4de6b_9099_4e65_8731_d9049564048c.slice/crio-2e002f4c67dce45326b2297f04c256101403b6d100bf7cd9be263b55c4f92801 WatchSource:0}: Error finding container 2e002f4c67dce45326b2297f04c256101403b6d100bf7cd9be263b55c4f92801: Status 404 returned error can't find the container with id 2e002f4c67dce45326b2297f04c256101403b6d100bf7cd9be263b55c4f92801 Jul 21 17:27:39.860747 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:39.860650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qnf2s" event={"ID":"0ced24b5-5f05-456a-9daa-98ac981d4ced","Type":"ContainerStarted","Data":"f844f293166600d138a81de603a57ad2a9b1b07781b3a9ec2dea1e950165fa0e"} Jul 21 17:27:39.862016 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:39.861980 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" event={"ID":"94e4de6b-9099-4e65-8731-d9049564048c","Type":"ContainerStarted","Data":"2e002f4c67dce45326b2297f04c256101403b6d100bf7cd9be263b55c4f92801"} Jul 21 17:27:40.866802 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:40.866774 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ced24b5-5f05-456a-9daa-98ac981d4ced" containerID="5d4e11496acc8262a1179a9a02a23a2908dce9a33204dde9b5cf38cf0d10bc6b" exitCode=0 Jul 21 17:27:40.867110 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:40.866831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qnf2s" event={"ID":"0ced24b5-5f05-456a-9daa-98ac981d4ced","Type":"ContainerDied","Data":"5d4e11496acc8262a1179a9a02a23a2908dce9a33204dde9b5cf38cf0d10bc6b"} Jul 21 17:27:41.385529 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.385492 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7754694b46-4dlxv"] Jul 21 17:27:41.388660 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.388639 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.391400 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.391377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2lv9leoi55l2u\"" Jul 21 17:27:41.391400 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.391379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 17:27:41.391709 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.391695 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8v9g7\"" Jul 21 17:27:41.391804 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.391775 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 17:27:41.391804 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.391793 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 17:27:41.391921 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.391871 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 17:27:41.392129 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.392111 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 17:27:41.404134 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.404108 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7754694b46-4dlxv"] Jul 21 17:27:41.454127 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.454089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.454127 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.454129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-grpc-tls\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.454359 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.454169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.454359 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.454203 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.454359 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.454233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.454359 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.454295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-tls\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.454359 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.454323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w78cl\" (UniqueName: \"kubernetes.io/projected/d41d5157-3f71-4341-b773-0ec755edd220-kube-api-access-w78cl\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.454359 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.454358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d41d5157-3f71-4341-b773-0ec755edd220-metrics-client-ca\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.554948 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.554912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.554948 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.554952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.555186 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.554974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.555186 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.555005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-tls\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.555186 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.555030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w78cl\" (UniqueName: \"kubernetes.io/projected/d41d5157-3f71-4341-b773-0ec755edd220-kube-api-access-w78cl\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.555186 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.555062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d41d5157-3f71-4341-b773-0ec755edd220-metrics-client-ca\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.555186 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.555106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.555186 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.555131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-grpc-tls\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.556173 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.556144 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d41d5157-3f71-4341-b773-0ec755edd220-metrics-client-ca\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.558231 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.558203 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.558334 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.558234 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-tls\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.558453 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.558431 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.558549 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.558526 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.558641 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.558530 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.558744 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.558726 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d41d5157-3f71-4341-b773-0ec755edd220-secret-grpc-tls\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.562600 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.562582 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w78cl\" (UniqueName: \"kubernetes.io/projected/d41d5157-3f71-4341-b773-0ec755edd220-kube-api-access-w78cl\") pod \"thanos-querier-7754694b46-4dlxv\" (UID: \"d41d5157-3f71-4341-b773-0ec755edd220\") " pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.698882 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.698779 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:41.837107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.836955 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7754694b46-4dlxv"] Jul 21 17:27:41.839719 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:41.839691 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41d5157_3f71_4341_b773_0ec755edd220.slice/crio-1a5f5bf63f58d6195fb698d74eca3bba0b9d262d5b08708b79740c9539eb2030 WatchSource:0}: Error finding container 1a5f5bf63f58d6195fb698d74eca3bba0b9d262d5b08708b79740c9539eb2030: Status 404 returned error can't find the container with id 1a5f5bf63f58d6195fb698d74eca3bba0b9d262d5b08708b79740c9539eb2030 Jul 21 17:27:41.872383 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.872341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qnf2s" event={"ID":"0ced24b5-5f05-456a-9daa-98ac981d4ced","Type":"ContainerStarted","Data":"cc3c0ab7240550fa50de3da488d1746a69c6713acceb85525f333ac7d7247c60"} Jul 21 17:27:41.872769 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.872398 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qnf2s" event={"ID":"0ced24b5-5f05-456a-9daa-98ac981d4ced","Type":"ContainerStarted","Data":"3d0153b7b7d17d6c6f7d4998c070d842a22baee13e8ccca40446b5e9262b1e1a"} Jul 21 17:27:41.874464 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.874435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" event={"ID":"94e4de6b-9099-4e65-8731-d9049564048c","Type":"ContainerStarted","Data":"bc7b642d413f8256f5b0bb25e76e844b1df44f2aaa7093f974359ad0229c4f7e"} Jul 21 17:27:41.874621 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.874491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" event={"ID":"94e4de6b-9099-4e65-8731-d9049564048c","Type":"ContainerStarted","Data":"8fd3429cfd07b0c5becc532b2a8f7c1f5feee843fd27340482c458e5c4b7651e"} Jul 21 17:27:41.874621 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.874523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" event={"ID":"94e4de6b-9099-4e65-8731-d9049564048c","Type":"ContainerStarted","Data":"4db9cf0fd3f323f3ae8810838880d5b28beeda58c088ad82c7c0b1098488a065"} Jul 21 17:27:41.875607 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.875586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" event={"ID":"d41d5157-3f71-4341-b773-0ec755edd220","Type":"ContainerStarted","Data":"1a5f5bf63f58d6195fb698d74eca3bba0b9d262d5b08708b79740c9539eb2030"} Jul 21 17:27:41.897860 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.897812 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qnf2s" podStartSLOduration=2.811613958 podStartE2EDuration="3.897797316s" totalImagesPullingTime="1.012012942s" totalInitContainerRuntime="74.170416ms" isStatefulPod=true podCreationTimestamp="2026-07-21 17:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:41.896446719 +0000 UTC m=+86.082451622" watchObservedRunningTime="2026-07-21 17:27:41.897797316 +0000 UTC m=+86.083802195" Jul 21 17:27:41.939452 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:41.939405 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-g6f7l" podStartSLOduration=2.141577918 podStartE2EDuration="3.939391079s" totalImagesPullingTime="1.797813161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:41.938098685 +0000 UTC m=+86.124103562" watchObservedRunningTime="2026-07-21 17:27:41.939391079 +0000 UTC m=+86.125395978" Jul 21 17:27:42.709643 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:42.709599 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:42.709941 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:42.709919 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:42.715959 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:42.715929 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:42.886461 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:42.886431 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:27:43.214059 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.214020 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-98c8c4c6b-spz5p"] Jul 21 17:27:43.216512 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.216491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.219599 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.219574 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 21 17:27:43.219900 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.219881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 17:27:43.220270 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.220124 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 21 17:27:43.220270 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.220130 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-p8md6\"" Jul 21 17:27:43.220450 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.220291 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 21 17:27:43.220450 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.220405 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fkhutrckjp02h\"" Jul 21 17:27:43.231994 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.231966 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-98c8c4c6b-spz5p"] Jul 21 17:27:43.271210 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.271171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-secret-metrics-server-client-certs\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.271389 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.271239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c2f821f-a9de-4ef9-ae3c-918bc020028f-audit-log\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.271389 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.271319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-secret-metrics-server-tls\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.271389 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.271355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c2f821f-a9de-4ef9-ae3c-918bc020028f-metrics-server-audit-profiles\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.271517 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.271392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-client-ca-bundle\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.271517 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.271415 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmxzc\" (UniqueName: \"kubernetes.io/projected/4c2f821f-a9de-4ef9-ae3c-918bc020028f-kube-api-access-pmxzc\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.271517 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.271433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2f821f-a9de-4ef9-ae3c-918bc020028f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.372580 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.372540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c2f821f-a9de-4ef9-ae3c-918bc020028f-audit-log\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.372711 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.372597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-secret-metrics-server-tls\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.372711 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.372628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c2f821f-a9de-4ef9-ae3c-918bc020028f-metrics-server-audit-profiles\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.372711 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.372661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-client-ca-bundle\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.372711 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.372695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxzc\" (UniqueName: \"kubernetes.io/projected/4c2f821f-a9de-4ef9-ae3c-918bc020028f-kube-api-access-pmxzc\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.372915 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.372726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2f821f-a9de-4ef9-ae3c-918bc020028f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.372915 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.372778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-secret-metrics-server-client-certs\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.373021 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.372981 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4c2f821f-a9de-4ef9-ae3c-918bc020028f-audit-log\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.373713 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.373688 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4c2f821f-a9de-4ef9-ae3c-918bc020028f-metrics-server-audit-profiles\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.373873 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.373852 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c2f821f-a9de-4ef9-ae3c-918bc020028f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.375379 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.375348 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-secret-metrics-server-tls\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.375822 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.375802 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-secret-metrics-server-client-certs\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.375916 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.375802 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4c2f821f-a9de-4ef9-ae3c-918bc020028f-client-ca-bundle\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.381059 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.381038 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmxzc\" (UniqueName: \"kubernetes.io/projected/4c2f821f-a9de-4ef9-ae3c-918bc020028f-kube-api-access-pmxzc\") pod \"metrics-server-98c8c4c6b-spz5p\" (UID: \"4c2f821f-a9de-4ef9-ae3c-918bc020028f\") " pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.529309 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.529286 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:27:43.664943 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.664910 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-98c8c4c6b-spz5p"] Jul 21 17:27:43.668214 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:43.668189 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2f821f_a9de_4ef9_ae3c_918bc020028f.slice/crio-12acff3f5501421aa0013c8bc629fbd72af0d841952c27080ae72fca23307d28 WatchSource:0}: Error finding container 12acff3f5501421aa0013c8bc629fbd72af0d841952c27080ae72fca23307d28: Status 404 returned error can't find the container with id 12acff3f5501421aa0013c8bc629fbd72af0d841952c27080ae72fca23307d28 Jul 21 17:27:43.723725 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.723655 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7"] Jul 21 17:27:43.727098 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.727078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.729810 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.729782 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 21 17:27:43.729978 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.729958 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-27fkz\"" Jul 21 17:27:43.730075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.730010 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 21 17:27:43.730075 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.730040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 21 17:27:43.730180 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.730013 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 21 17:27:43.730230 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.730181 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 21 17:27:43.735041 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.735019 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 21 17:27:43.741276 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.741254 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7"] Jul 21 17:27:43.877244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.877208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-secret-telemeter-client\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.877244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.877250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-serving-certs-ca-bundle\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.877454 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.877269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-metrics-client-ca\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.877454 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.877339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.877454 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.877376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-federate-client-tls\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.877454 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.877410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-telemeter-client-tls\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.877454 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.877437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.877647 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.877462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp2hl\" (UniqueName: \"kubernetes.io/projected/ea302c6e-07d5-43e0-a395-dc574f18e4c3-kube-api-access-zp2hl\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.886241 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.886202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" event={"ID":"d41d5157-3f71-4341-b773-0ec755edd220","Type":"ContainerStarted","Data":"2714d4a0abe97a22242eda7f41b234aadc2b2996c861dac1bad5e463fc0dcf2e"} Jul 21 17:27:43.886388 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.886294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" event={"ID":"d41d5157-3f71-4341-b773-0ec755edd220","Type":"ContainerStarted","Data":"96734f7bcda84e732218587b21216468d4d0cf5d45561c70f6e563eed2c35d14"} Jul 21 17:27:43.886388 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.886337 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" event={"ID":"d41d5157-3f71-4341-b773-0ec755edd220","Type":"ContainerStarted","Data":"9d0901727d5e84287cc981ccc6354730f4b0d63ca5f5ab2a60c50c3513fb5ba2"} Jul 21 17:27:43.887410 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.887383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" event={"ID":"4c2f821f-a9de-4ef9-ae3c-918bc020028f","Type":"ContainerStarted","Data":"12acff3f5501421aa0013c8bc629fbd72af0d841952c27080ae72fca23307d28"} Jul 21 17:27:43.978305 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.978198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-serving-certs-ca-bundle\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.978305 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.978232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-metrics-client-ca\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.978305 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.978264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.978305 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.978282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-federate-client-tls\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.978305 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.978315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-telemeter-client-tls\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.978924 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.978342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.978924 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.978369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp2hl\" (UniqueName: \"kubernetes.io/projected/ea302c6e-07d5-43e0-a395-dc574f18e4c3-kube-api-access-zp2hl\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.978924 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.978496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-secret-telemeter-client\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.979107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.979086 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-serving-certs-ca-bundle\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.979620 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.979355 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-metrics-client-ca\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.979620 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.979379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea302c6e-07d5-43e0-a395-dc574f18e4c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.981639 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.981618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-secret-telemeter-client\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.981743 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.981719 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-federate-client-tls\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.981743 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.981720 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-telemeter-client-tls\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.982371 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.982352 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea302c6e-07d5-43e0-a395-dc574f18e4c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:43.990575 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:43.990537 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp2hl\" (UniqueName: \"kubernetes.io/projected/ea302c6e-07d5-43e0-a395-dc574f18e4c3-kube-api-access-zp2hl\") pod \"telemeter-client-754fb5fcdf-lhvq7\" (UID: \"ea302c6e-07d5-43e0-a395-dc574f18e4c3\") " pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:44.036641 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.036605 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" Jul 21 17:27:44.203631 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.203592 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7"] Jul 21 17:27:44.295094 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:44.295017 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea302c6e_07d5_43e0_a395_dc574f18e4c3.slice/crio-acff4515ac0c4fd144a8f63c5871f1495ab1f950722e3284666a0086aff0716c WatchSource:0}: Error finding container acff4515ac0c4fd144a8f63c5871f1495ab1f950722e3284666a0086aff0716c: Status 404 returned error can't find the container with id acff4515ac0c4fd144a8f63c5871f1495ab1f950722e3284666a0086aff0716c Jul 21 17:27:44.789747 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.789718 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:27:44.793395 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.793376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.797951 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.797932 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 17:27:44.798849 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.798828 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 17:27:44.799065 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 17:27:44.799065 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799056 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8v4h9\"" Jul 21 17:27:44.799237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 17:27:44.799237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799050 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 17:27:44.799237 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799172 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 17:27:44.799395 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799359 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 17:27:44.800074 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799625 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fd34u5v067bm1\"" Jul 21 17:27:44.800074 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799628 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 17:27:44.800074 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799639 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 17:27:44.800074 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.799962 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 17:27:44.800486 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.800226 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 17:27:44.800486 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.800389 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 17:27:44.801410 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.801384 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 17:27:44.809410 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.809381 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 17:27:44.819470 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.819441 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:27:44.886871 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.886835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887034 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.886882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887034 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.886941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887034 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.886984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887034 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887187 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887187 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-config\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887187 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887187 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887187 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887187 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms5k2\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-kube-api-access-ms5k2\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887300 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.887422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.887393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.896023 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.895987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" event={"ID":"d41d5157-3f71-4341-b773-0ec755edd220","Type":"ContainerStarted","Data":"c0ca1d4762a6b095be34ef9f44b2396e624f841bcf6975193db01cf2d4c3612b"} Jul 21 17:27:44.896172 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.896059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" event={"ID":"d41d5157-3f71-4341-b773-0ec755edd220","Type":"ContainerStarted","Data":"7ce0da3c32d044a56857fd5e049a3f3f6f711014bb6c2823cdc3039b1dc3ba9f"} Jul 21 17:27:44.896172 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.896084 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" event={"ID":"d41d5157-3f71-4341-b773-0ec755edd220","Type":"ContainerStarted","Data":"62be3aa4c15fe8123d918bacb929e4b5f553ac415656c84171aac5d63d3cc075"} Jul 21 17:27:44.896591 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.896493 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:44.898990 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.898931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" event={"ID":"ea302c6e-07d5-43e0-a395-dc574f18e4c3","Type":"ContainerStarted","Data":"acff4515ac0c4fd144a8f63c5871f1495ab1f950722e3284666a0086aff0716c"} Jul 21 17:27:44.922636 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.922571 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" podStartSLOduration=1.6153309999999999 podStartE2EDuration="3.922532864s" totalImagesPullingTime="2.307201864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:44.921350425 +0000 UTC m=+89.107355306" watchObservedRunningTime="2026-07-21 17:27:44.922532864 +0000 UTC m=+89.108537738" Jul 21 17:27:44.988263 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988445 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988445 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988445 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988445 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988445 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988783 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988783 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988783 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988997 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988997 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-config\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.988997 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.989303 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.988981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.989303 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.989131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.989412 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.989301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.989412 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.989335 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.989770 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.989746 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.990209 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.990185 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.991258 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.991140 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.992028 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.991712 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.992028 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.991798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.992028 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.991845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.992028 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.991883 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms5k2\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-kube-api-access-ms5k2\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.992028 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.991913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.992028 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.991956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.992369 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.992321 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.993325 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.992806 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.993325 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.992924 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.993325 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.993105 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.993325 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.993157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.993598 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.993577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.993921 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.993893 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.995599 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.995577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.995742 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.995691 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-config\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.995849 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.995789 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.996264 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.996240 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.996480 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.996462 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.996758 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.996735 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:44.997119 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:44.997096 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:45.001823 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:45.001802 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms5k2\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-kube-api-access-ms5k2\") pod \"prometheus-k8s-0\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:45.103346 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:45.103046 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:45.553190 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:45.553157 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:27:45.556803 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:27:45.556768 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63630436_a757_4050_8388_898a4783f7c4.slice/crio-b8a3efc5cfcd4c148121e8e61b6f6f339ffb31bbe1e9f45fc64b8670041f6a53 WatchSource:0}: Error finding container b8a3efc5cfcd4c148121e8e61b6f6f339ffb31bbe1e9f45fc64b8670041f6a53: Status 404 returned error can't find the container with id b8a3efc5cfcd4c148121e8e61b6f6f339ffb31bbe1e9f45fc64b8670041f6a53 Jul 21 17:27:45.904533 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:45.904439 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerStarted","Data":"b8a3efc5cfcd4c148121e8e61b6f6f339ffb31bbe1e9f45fc64b8670041f6a53"} Jul 21 17:27:45.906597 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:45.906318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" event={"ID":"4c2f821f-a9de-4ef9-ae3c-918bc020028f","Type":"ContainerStarted","Data":"a02c4b359a48778f690a86939c0cc2ce22c8c73141c4e90aa8dcc9eae6d64866"} Jul 21 17:27:45.927329 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:45.927276 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" podStartSLOduration=1.1619400579999999 podStartE2EDuration="2.927223623s" totalImagesPullingTime="1.765283565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:45.926339093 +0000 UTC m=+90.112343973" watchObservedRunningTime="2026-07-21 17:27:45.927223623 +0000 UTC m=+90.113228504" Jul 21 17:27:46.912098 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:46.912054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" event={"ID":"ea302c6e-07d5-43e0-a395-dc574f18e4c3","Type":"ContainerStarted","Data":"84196190771e9f622ea22d2c4361f020e689c78cfc8472bbf87b2c831ac59a3c"} Jul 21 17:27:47.917459 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:47.917423 2562 generic.go:356] "Generic (PLEG): container finished" podID="63630436-a757-4050-8388-898a4783f7c4" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" exitCode=0 Jul 21 17:27:47.917897 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:47.917520 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerDied","Data":"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d"} Jul 21 17:27:47.919796 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:47.919775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" event={"ID":"ea302c6e-07d5-43e0-a395-dc574f18e4c3","Type":"ContainerStarted","Data":"85c72ee20c7fbb1527fe5f769f39dcfdd56e452ac6ee2affebb462d260cb0075"} Jul 21 17:27:47.919887 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:47.919821 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" event={"ID":"ea302c6e-07d5-43e0-a395-dc574f18e4c3","Type":"ContainerStarted","Data":"0f10dc6ca78068992c36dbed52081e9469ed40c2104fce134543e3d846b04b95"} Jul 21 17:27:47.972412 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:47.972365 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-754fb5fcdf-lhvq7" podStartSLOduration=2.247336425 podStartE2EDuration="4.972349398s" totalImagesPullingTime="2.725012973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:47.970243168 +0000 UTC m=+92.156248049" watchObservedRunningTime="2026-07-21 17:27:47.972349398 +0000 UTC m=+92.158354278" Jul 21 17:27:49.811545 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:49.811515 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64f8d6c587-nwnmb" Jul 21 17:27:50.914307 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:50.914272 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7754694b46-4dlxv" Jul 21 17:27:51.943172 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:51.943139 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerStarted","Data":"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946"} Jul 21 17:27:51.943709 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:51.943239 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerStarted","Data":"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b"} Jul 21 17:27:51.943709 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:51.943268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerStarted","Data":"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d"} Jul 21 17:27:51.943709 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:51.943301 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerStarted","Data":"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2"} Jul 21 17:27:51.943709 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:51.943325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerStarted","Data":"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1"} Jul 21 17:27:51.943709 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:51.943349 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerStarted","Data":"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7"} Jul 21 17:27:51.979180 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:51.979129 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.3276972799999998 podStartE2EDuration="7.979113026s" totalImagesPullingTime="4.636470257s" totalInitContainerRuntime="14.945489ms" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:51.97705533 +0000 UTC m=+96.163060221" watchObservedRunningTime="2026-07-21 17:27:51.979113026 +0000 UTC m=+96.165117907" Jul 21 17:27:55.103340 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:55.103305 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:27:59.405134 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:59.405098 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf7b75d75-42n5x"] Jul 21 17:27:59.809277 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:27:59.809249 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-57xw5" Jul 21 17:28:03.530475 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:03.530425 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:28:03.530997 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:03.530507 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:28:23.535442 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:23.535410 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:28:23.539641 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:23.539612 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-98c8c4c6b-spz5p" Jul 21 17:28:24.426567 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.426513 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cf7b75d75-42n5x" podUID="a6157007-9c7f-4972-9952-2999420c0816" containerName="console" containerID="cri-o://8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f" gracePeriod=15 Jul 21 17:28:24.675695 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.675670 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:28:24.752491 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.752461 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-console-config\") pod \"a6157007-9c7f-4972-9952-2999420c0816\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " Jul 21 17:28:24.752674 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.752505 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-oauth-serving-cert\") pod \"a6157007-9c7f-4972-9952-2999420c0816\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " Jul 21 17:28:24.752674 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.752548 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-867x2\" (UniqueName: \"kubernetes.io/projected/a6157007-9c7f-4972-9952-2999420c0816-kube-api-access-867x2\") pod \"a6157007-9c7f-4972-9952-2999420c0816\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " Jul 21 17:28:24.752674 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.752611 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-serving-cert\") pod \"a6157007-9c7f-4972-9952-2999420c0816\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " Jul 21 17:28:24.752674 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.752628 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-service-ca\") pod \"a6157007-9c7f-4972-9952-2999420c0816\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " Jul 21 17:28:24.752880 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.752682 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-oauth-config\") pod \"a6157007-9c7f-4972-9952-2999420c0816\" (UID: \"a6157007-9c7f-4972-9952-2999420c0816\") " Jul 21 17:28:24.752936 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.752892 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6157007-9c7f-4972-9952-2999420c0816" (UID: "a6157007-9c7f-4972-9952-2999420c0816"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:28:24.752936 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.752904 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-console-config" (OuterVolumeSpecName: "console-config") pod "a6157007-9c7f-4972-9952-2999420c0816" (UID: "a6157007-9c7f-4972-9952-2999420c0816"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:28:24.753160 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.753119 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6157007-9c7f-4972-9952-2999420c0816" (UID: "a6157007-9c7f-4972-9952-2999420c0816"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:28:24.755300 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.755239 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6157007-9c7f-4972-9952-2999420c0816-kube-api-access-867x2" (OuterVolumeSpecName: "kube-api-access-867x2") pod "a6157007-9c7f-4972-9952-2999420c0816" (UID: "a6157007-9c7f-4972-9952-2999420c0816"). InnerVolumeSpecName "kube-api-access-867x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:28:24.755508 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.755451 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6157007-9c7f-4972-9952-2999420c0816" (UID: "a6157007-9c7f-4972-9952-2999420c0816"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:28:24.755760 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.755731 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6157007-9c7f-4972-9952-2999420c0816" (UID: "a6157007-9c7f-4972-9952-2999420c0816"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:28:24.854496 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.854356 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-867x2\" (UniqueName: \"kubernetes.io/projected/a6157007-9c7f-4972-9952-2999420c0816-kube-api-access-867x2\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:28:24.854496 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.854394 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-serving-cert\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:28:24.854496 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.854410 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-service-ca\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:28:24.854496 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.854424 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6157007-9c7f-4972-9952-2999420c0816-console-oauth-config\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:28:24.854496 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.854441 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-console-config\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:28:24.854496 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:24.854454 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6157007-9c7f-4972-9952-2999420c0816-oauth-serving-cert\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:28:25.074262 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.074186 2562 generic.go:356] "Generic (PLEG): container finished" podID="a6157007-9c7f-4972-9952-2999420c0816" containerID="8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f" exitCode=0 Jul 21 17:28:25.074262 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.074228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7b75d75-42n5x" event={"ID":"a6157007-9c7f-4972-9952-2999420c0816","Type":"ContainerDied","Data":"8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f"} Jul 21 17:28:25.074262 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.074245 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf7b75d75-42n5x" Jul 21 17:28:25.074514 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.074269 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf7b75d75-42n5x" event={"ID":"a6157007-9c7f-4972-9952-2999420c0816","Type":"ContainerDied","Data":"edc01819cef2cee9f6b416525eacec97b6312426cab209c48a1136e0f3714723"} Jul 21 17:28:25.074514 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.074289 2562 scope.go:117] "RemoveContainer" containerID="8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f" Jul 21 17:28:25.084011 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.083987 2562 scope.go:117] "RemoveContainer" containerID="8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f" Jul 21 17:28:25.084302 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:28:25.084282 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f\": container with ID starting with 8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f not found: ID does not exist" containerID="8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f" Jul 21 17:28:25.084378 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.084314 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f"} err="failed to get container status \"8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f\": rpc error: code = NotFound desc = could not find container \"8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f\": container with ID starting with 8960f6e76ab271f3facbc8b15ea0fc58aaa347fece189245a2727c2d701b8f3f not found: ID does not exist" Jul 21 17:28:25.097007 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.096967 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cf7b75d75-42n5x"] Jul 21 17:28:25.101341 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:25.101301 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cf7b75d75-42n5x"] Jul 21 17:28:26.360300 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:26.360255 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6157007-9c7f-4972-9952-2999420c0816" path="/var/lib/kubelet/pods/a6157007-9c7f-4972-9952-2999420c0816/volumes" Jul 21 17:28:45.103815 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:45.103777 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:28:45.124452 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:45.124427 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:28:45.170960 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:28:45.170936 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:03.174849 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.174814 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:29:03.175370 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.175102 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="prometheus" containerID="cri-o://38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" gracePeriod=600 Jul 21 17:29:03.175370 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.175120 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy" containerID="cri-o://05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" gracePeriod=600 Jul 21 17:29:03.175370 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.175159 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="thanos-sidecar" containerID="cri-o://2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" gracePeriod=600 Jul 21 17:29:03.175370 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.175184 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" gracePeriod=600 Jul 21 17:29:03.175370 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.175188 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy-web" containerID="cri-o://5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" gracePeriod=600 Jul 21 17:29:03.175370 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.175209 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="config-reloader" containerID="cri-o://4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" gracePeriod=600 Jul 21 17:29:03.421158 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.421134 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:03.469005 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.468981 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-1\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469016 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-tls-assets\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-metrics-client-ca\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469071 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-thanos-prometheus-http-client-file\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469104 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-config\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469128 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-config-out\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469150 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-metrics-client-certs\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469181 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms5k2\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-kube-api-access-ms5k2\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469203 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-grpc-tls\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469237 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469266 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469290 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-tls\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469321 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-trusted-ca-bundle\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469364 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-kubelet-serving-ca-bundle\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469391 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-0\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469416 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-serving-certs-ca-bundle\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469435 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469457 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-2\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469456 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469480 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-kube-rbac-proxy\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.469541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469533 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-db\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.470212 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469581 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-web-config\") pod \"63630436-a757-4050-8388-898a4783f7c4\" (UID: \"63630436-a757-4050-8388-898a4783f7c4\") " Jul 21 17:29:03.470212 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469875 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.470212 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469899 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-metrics-client-ca\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.470212 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469912 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:03.470212 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.469925 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:03.470765 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.470694 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:03.470876 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.470761 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:03.471543 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.471512 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:29:03.474375 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.474335 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.474375 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.474345 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:29:03.474919 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.474894 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.475097 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.475066 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-config-out" (OuterVolumeSpecName: "config-out") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:29:03.475182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.475136 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.475372 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.475331 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-config" (OuterVolumeSpecName: "config") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.475586 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.475530 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:29:03.475586 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.475549 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.475586 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.475574 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-kube-api-access-ms5k2" (OuterVolumeSpecName: "kube-api-access-ms5k2") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "kube-api-access-ms5k2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:29:03.475727 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.475590 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.477128 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.477107 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.477351 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.477334 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.488270 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.488244 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-web-config" (OuterVolumeSpecName: "web-config") pod "63630436-a757-4050-8388-898a4783f7c4" (UID: "63630436-a757-4050-8388-898a4783f7c4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:29:03.571000 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.570966 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-db\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571000 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.570991 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-web-config\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571000 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571001 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-tls-assets\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571000 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571010 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571020 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-config\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571027 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63630436-a757-4050-8388-898a4783f7c4-config-out\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571037 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-metrics-client-certs\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571044 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms5k2\" (UniqueName: \"kubernetes.io/projected/63630436-a757-4050-8388-898a4783f7c4-kube-api-access-ms5k2\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571052 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-grpc-tls\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571061 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571070 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571078 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571086 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571094 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571102 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571110 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571118 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63630436-a757-4050-8388-898a4783f7c4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:03.571244 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:03.571125 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63630436-a757-4050-8388-898a4783f7c4-secret-kube-rbac-proxy\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:29:04.228844 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228813 2562 generic.go:356] "Generic (PLEG): container finished" podID="63630436-a757-4050-8388-898a4783f7c4" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" exitCode=0 Jul 21 17:29:04.228844 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228838 2562 generic.go:356] "Generic (PLEG): container finished" podID="63630436-a757-4050-8388-898a4783f7c4" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" exitCode=0 Jul 21 17:29:04.228844 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228844 2562 generic.go:356] "Generic (PLEG): container finished" podID="63630436-a757-4050-8388-898a4783f7c4" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" exitCode=0 Jul 21 17:29:04.228844 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228849 2562 generic.go:356] "Generic (PLEG): container finished" podID="63630436-a757-4050-8388-898a4783f7c4" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" exitCode=0 Jul 21 17:29:04.228844 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228854 2562 generic.go:356] "Generic (PLEG): container finished" podID="63630436-a757-4050-8388-898a4783f7c4" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" exitCode=0 Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228859 2562 generic.go:356] "Generic (PLEG): container finished" podID="63630436-a757-4050-8388-898a4783f7c4" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" exitCode=0 Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerDied","Data":"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946"} Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228925 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerDied","Data":"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b"} Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.228987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerDied","Data":"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d"} Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.229011 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerDied","Data":"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2"} Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.229041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerDied","Data":"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1"} Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.229036 2562 scope.go:117] "RemoveContainer" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.229070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerDied","Data":"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7"} Jul 21 17:29:04.229476 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.229093 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63630436-a757-4050-8388-898a4783f7c4","Type":"ContainerDied","Data":"b8a3efc5cfcd4c148121e8e61b6f6f339ffb31bbe1e9f45fc64b8670041f6a53"} Jul 21 17:29:04.239896 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.239878 2562 scope.go:117] "RemoveContainer" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" Jul 21 17:29:04.246901 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.246885 2562 scope.go:117] "RemoveContainer" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" Jul 21 17:29:04.254243 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.254217 2562 scope.go:117] "RemoveContainer" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" Jul 21 17:29:04.254678 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.254660 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:29:04.258525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.258498 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:29:04.261602 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.261585 2562 scope.go:117] "RemoveContainer" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" Jul 21 17:29:04.268196 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.268180 2562 scope.go:117] "RemoveContainer" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" Jul 21 17:29:04.275193 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.275171 2562 scope.go:117] "RemoveContainer" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" Jul 21 17:29:04.283508 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.283491 2562 scope.go:117] "RemoveContainer" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" Jul 21 17:29:04.283809 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:29:04.283790 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": container with ID starting with 6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946 not found: ID does not exist" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" Jul 21 17:29:04.283898 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.283820 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946"} err="failed to get container status \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": rpc error: code = NotFound desc = could not find container \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": container with ID starting with 6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946 not found: ID does not exist" Jul 21 17:29:04.283898 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.283846 2562 scope.go:117] "RemoveContainer" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" Jul 21 17:29:04.284104 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284087 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:29:04.284209 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:29:04.284092 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": container with ID starting with 05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b not found: ID does not exist" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" Jul 21 17:29:04.284262 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284221 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b"} err="failed to get container status \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": rpc error: code = NotFound desc = could not find container \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": container with ID starting with 05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b not found: ID does not exist" Jul 21 17:29:04.284262 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284246 2562 scope.go:117] "RemoveContainer" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" Jul 21 17:29:04.284378 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284364 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="init-config-reloader" Jul 21 17:29:04.284413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284381 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="init-config-reloader" Jul 21 17:29:04.284413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284396 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy" Jul 21 17:29:04.284413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284405 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284416 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="config-reloader" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284421 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="config-reloader" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284426 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy-web" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284431 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy-web" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284439 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="prometheus" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284444 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="prometheus" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284453 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6157007-9c7f-4972-9952-2999420c0816" containerName="console" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284461 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6157007-9c7f-4972-9952-2999420c0816" containerName="console" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284470 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="thanos-sidecar" Jul 21 17:29:04.284500 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:29:04.284469 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": container with ID starting with 5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d not found: ID does not exist" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284494 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d"} err="failed to get container status \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": rpc error: code = NotFound desc = could not find container \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": container with ID starting with 5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d not found: ID does not exist" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284520 2562 scope.go:117] "RemoveContainer" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284475 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="thanos-sidecar" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284579 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy-thanos" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284585 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy-thanos" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284672 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="prometheus" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284685 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="thanos-sidecar" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284693 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="config-reloader" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284703 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy-web" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284713 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284721 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6157007-9c7f-4972-9952-2999420c0816" containerName="console" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284727 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63630436-a757-4050-8388-898a4783f7c4" containerName="kube-rbac-proxy-thanos" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:29:04.284731 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": container with ID starting with 2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2 not found: ID does not exist" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284746 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2"} err="failed to get container status \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": rpc error: code = NotFound desc = could not find container \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": container with ID starting with 2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2 not found: ID does not exist" Jul 21 17:29:04.284863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.284758 2562 scope.go:117] "RemoveContainer" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" Jul 21 17:29:04.285357 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:29:04.284991 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": container with ID starting with 4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1 not found: ID does not exist" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" Jul 21 17:29:04.285357 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.285014 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1"} err="failed to get container status \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": rpc error: code = NotFound desc = could not find container \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": container with ID starting with 4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1 not found: ID does not exist" Jul 21 17:29:04.285357 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.285029 2562 scope.go:117] "RemoveContainer" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" Jul 21 17:29:04.285357 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:29:04.285237 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": container with ID starting with 38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7 not found: ID does not exist" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" Jul 21 17:29:04.285357 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.285260 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7"} err="failed to get container status \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": rpc error: code = NotFound desc = could not find container \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": container with ID starting with 38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7 not found: ID does not exist" Jul 21 17:29:04.285357 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.285273 2562 scope.go:117] "RemoveContainer" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" Jul 21 17:29:04.285547 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:29:04.285471 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": container with ID starting with bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d not found: ID does not exist" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" Jul 21 17:29:04.285547 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.285488 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d"} err="failed to get container status \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": rpc error: code = NotFound desc = could not find container \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": container with ID starting with bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d not found: ID does not exist" Jul 21 17:29:04.285547 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.285509 2562 scope.go:117] "RemoveContainer" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" Jul 21 17:29:04.285782 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.285759 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946"} err="failed to get container status \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": rpc error: code = NotFound desc = could not find container \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": container with ID starting with 6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946 not found: ID does not exist" Jul 21 17:29:04.285826 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.285785 2562 scope.go:117] "RemoveContainer" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" Jul 21 17:29:04.286043 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286023 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b"} err="failed to get container status \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": rpc error: code = NotFound desc = could not find container \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": container with ID starting with 05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b not found: ID does not exist" Jul 21 17:29:04.286100 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286043 2562 scope.go:117] "RemoveContainer" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" Jul 21 17:29:04.286253 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286238 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d"} err="failed to get container status \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": rpc error: code = NotFound desc = could not find container \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": container with ID starting with 5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d not found: ID does not exist" Jul 21 17:29:04.286253 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286252 2562 scope.go:117] "RemoveContainer" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" Jul 21 17:29:04.286440 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286426 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2"} err="failed to get container status \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": rpc error: code = NotFound desc = could not find container \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": container with ID starting with 2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2 not found: ID does not exist" Jul 21 17:29:04.286440 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286439 2562 scope.go:117] "RemoveContainer" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" Jul 21 17:29:04.286645 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286629 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1"} err="failed to get container status \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": rpc error: code = NotFound desc = could not find container \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": container with ID starting with 4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1 not found: ID does not exist" Jul 21 17:29:04.286645 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286644 2562 scope.go:117] "RemoveContainer" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" Jul 21 17:29:04.286848 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286830 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7"} err="failed to get container status \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": rpc error: code = NotFound desc = could not find container \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": container with ID starting with 38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7 not found: ID does not exist" Jul 21 17:29:04.286889 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.286850 2562 scope.go:117] "RemoveContainer" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" Jul 21 17:29:04.287048 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287031 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d"} err="failed to get container status \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": rpc error: code = NotFound desc = could not find container \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": container with ID starting with bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d not found: ID does not exist" Jul 21 17:29:04.287096 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287051 2562 scope.go:117] "RemoveContainer" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" Jul 21 17:29:04.287280 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287264 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946"} err="failed to get container status \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": rpc error: code = NotFound desc = could not find container \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": container with ID starting with 6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946 not found: ID does not exist" Jul 21 17:29:04.287328 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287281 2562 scope.go:117] "RemoveContainer" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" Jul 21 17:29:04.287489 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287471 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b"} err="failed to get container status \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": rpc error: code = NotFound desc = could not find container \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": container with ID starting with 05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b not found: ID does not exist" Jul 21 17:29:04.287530 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287491 2562 scope.go:117] "RemoveContainer" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" Jul 21 17:29:04.287705 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287688 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d"} err="failed to get container status \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": rpc error: code = NotFound desc = could not find container \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": container with ID starting with 5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d not found: ID does not exist" Jul 21 17:29:04.287747 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287707 2562 scope.go:117] "RemoveContainer" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" Jul 21 17:29:04.287910 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287865 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2"} err="failed to get container status \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": rpc error: code = NotFound desc = could not find container \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": container with ID starting with 2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2 not found: ID does not exist" Jul 21 17:29:04.287910 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.287892 2562 scope.go:117] "RemoveContainer" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" Jul 21 17:29:04.288049 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288028 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1"} err="failed to get container status \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": rpc error: code = NotFound desc = could not find container \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": container with ID starting with 4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1 not found: ID does not exist" Jul 21 17:29:04.288049 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288040 2562 scope.go:117] "RemoveContainer" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" Jul 21 17:29:04.288227 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288209 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7"} err="failed to get container status \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": rpc error: code = NotFound desc = could not find container \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": container with ID starting with 38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7 not found: ID does not exist" Jul 21 17:29:04.288303 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288228 2562 scope.go:117] "RemoveContainer" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" Jul 21 17:29:04.288471 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288451 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d"} err="failed to get container status \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": rpc error: code = NotFound desc = could not find container \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": container with ID starting with bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d not found: ID does not exist" Jul 21 17:29:04.288471 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288470 2562 scope.go:117] "RemoveContainer" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" Jul 21 17:29:04.288740 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288719 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946"} err="failed to get container status \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": rpc error: code = NotFound desc = could not find container \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": container with ID starting with 6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946 not found: ID does not exist" Jul 21 17:29:04.288815 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288742 2562 scope.go:117] "RemoveContainer" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" Jul 21 17:29:04.288964 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288947 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b"} err="failed to get container status \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": rpc error: code = NotFound desc = could not find container \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": container with ID starting with 05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b not found: ID does not exist" Jul 21 17:29:04.289032 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.288964 2562 scope.go:117] "RemoveContainer" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" Jul 21 17:29:04.289184 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.289161 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d"} err="failed to get container status \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": rpc error: code = NotFound desc = could not find container \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": container with ID starting with 5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d not found: ID does not exist" Jul 21 17:29:04.289257 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.289186 2562 scope.go:117] "RemoveContainer" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" Jul 21 17:29:04.289387 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.289371 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2"} err="failed to get container status \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": rpc error: code = NotFound desc = could not find container \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": container with ID starting with 2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2 not found: ID does not exist" Jul 21 17:29:04.289456 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.289388 2562 scope.go:117] "RemoveContainer" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" Jul 21 17:29:04.289597 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.289579 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1"} err="failed to get container status \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": rpc error: code = NotFound desc = could not find container \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": container with ID starting with 4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1 not found: ID does not exist" Jul 21 17:29:04.289661 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.289598 2562 scope.go:117] "RemoveContainer" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" Jul 21 17:29:04.289791 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.289775 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7"} err="failed to get container status \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": rpc error: code = NotFound desc = could not find container \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": container with ID starting with 38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7 not found: ID does not exist" Jul 21 17:29:04.289856 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.289792 2562 scope.go:117] "RemoveContainer" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" Jul 21 17:29:04.290027 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290009 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d"} err="failed to get container status \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": rpc error: code = NotFound desc = could not find container \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": container with ID starting with bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d not found: ID does not exist" Jul 21 17:29:04.290081 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290029 2562 scope.go:117] "RemoveContainer" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" Jul 21 17:29:04.290125 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290087 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.290213 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290192 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946"} err="failed to get container status \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": rpc error: code = NotFound desc = could not find container \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": container with ID starting with 6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946 not found: ID does not exist" Jul 21 17:29:04.290265 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290214 2562 scope.go:117] "RemoveContainer" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" Jul 21 17:29:04.290498 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290465 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b"} err="failed to get container status \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": rpc error: code = NotFound desc = could not find container \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": container with ID starting with 05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b not found: ID does not exist" Jul 21 17:29:04.290498 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290498 2562 scope.go:117] "RemoveContainer" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" Jul 21 17:29:04.290808 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290787 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d"} err="failed to get container status \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": rpc error: code = NotFound desc = could not find container \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": container with ID starting with 5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d not found: ID does not exist" Jul 21 17:29:04.290808 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.290807 2562 scope.go:117] "RemoveContainer" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" Jul 21 17:29:04.291038 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.291019 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2"} err="failed to get container status \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": rpc error: code = NotFound desc = could not find container \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": container with ID starting with 2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2 not found: ID does not exist" Jul 21 17:29:04.291085 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.291041 2562 scope.go:117] "RemoveContainer" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" Jul 21 17:29:04.291303 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.291284 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1"} err="failed to get container status \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": rpc error: code = NotFound desc = could not find container \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": container with ID starting with 4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1 not found: ID does not exist" Jul 21 17:29:04.291376 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.291305 2562 scope.go:117] "RemoveContainer" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" Jul 21 17:29:04.291545 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.291528 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7"} err="failed to get container status \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": rpc error: code = NotFound desc = could not find container \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": container with ID starting with 38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7 not found: ID does not exist" Jul 21 17:29:04.291636 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.291545 2562 scope.go:117] "RemoveContainer" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" Jul 21 17:29:04.291872 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.291852 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d"} err="failed to get container status \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": rpc error: code = NotFound desc = could not find container \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": container with ID starting with bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d not found: ID does not exist" Jul 21 17:29:04.291940 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.291872 2562 scope.go:117] "RemoveContainer" containerID="6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946" Jul 21 17:29:04.292137 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292117 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946"} err="failed to get container status \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": rpc error: code = NotFound desc = could not find container \"6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946\": container with ID starting with 6438d28225b77fcbf626ff99df2c68d3f7654c0e56527031385714c6c500b946 not found: ID does not exist" Jul 21 17:29:04.292203 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292138 2562 scope.go:117] "RemoveContainer" containerID="05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b" Jul 21 17:29:04.292435 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292415 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b"} err="failed to get container status \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": rpc error: code = NotFound desc = could not find container \"05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b\": container with ID starting with 05d2d2a74e7f6415d76a1877818d035801c31ce9bd0945f82d1b4b73886fd28b not found: ID does not exist" Jul 21 17:29:04.292492 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292436 2562 scope.go:117] "RemoveContainer" containerID="5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d" Jul 21 17:29:04.292777 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292752 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d"} err="failed to get container status \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": rpc error: code = NotFound desc = could not find container \"5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d\": container with ID starting with 5c0fb72dcbded2f534dadf568abfab3e4317829dd7439f31f85d98e9976a667d not found: ID does not exist" Jul 21 17:29:04.292879 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292776 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8v4h9\"" Jul 21 17:29:04.292879 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292776 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 17:29:04.292879 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292779 2562 scope.go:117] "RemoveContainer" containerID="2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2" Jul 21 17:29:04.292879 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292781 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 17:29:04.293092 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.292898 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 17:29:04.293092 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293082 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 17:29:04.293185 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 17:29:04.293185 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293171 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 17:29:04.293286 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293176 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2"} err="failed to get container status \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": rpc error: code = NotFound desc = could not find container \"2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2\": container with ID starting with 2d15a18231093a4518b9b12116218d5bfe5471fd18c3df646fbdbaeb1a99a7f2 not found: ID does not exist" Jul 21 17:29:04.293286 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293241 2562 scope.go:117] "RemoveContainer" containerID="4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1" Jul 21 17:29:04.293286 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293274 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fd34u5v067bm1\"" Jul 21 17:29:04.293420 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293326 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 17:29:04.293522 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293500 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1"} err="failed to get container status \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": rpc error: code = NotFound desc = could not find container \"4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1\": container with ID starting with 4847935f51e90f986f8859591bb1e98d710bf11149c751585eaa783e061a68c1 not found: ID does not exist" Jul 21 17:29:04.293522 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293517 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 17:29:04.293657 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293525 2562 scope.go:117] "RemoveContainer" containerID="38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7" Jul 21 17:29:04.293657 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293622 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 17:29:04.293822 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293793 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7"} err="failed to get container status \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": rpc error: code = NotFound desc = could not find container \"38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7\": container with ID starting with 38f45ebcca6788f12196f9d437f5d51558c082269838d93aef596a7ebcb42cc7 not found: ID does not exist" Jul 21 17:29:04.293879 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.293825 2562 scope.go:117] "RemoveContainer" containerID="bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d" Jul 21 17:29:04.294140 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.294118 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d"} err="failed to get container status \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": rpc error: code = NotFound desc = could not find container \"bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d\": container with ID starting with bafc6e3ff1e352e887c1adbfb715e19c867ccfaa7f37b9bf9e9531066d7c1e3d not found: ID does not exist" Jul 21 17:29:04.294213 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.294204 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 17:29:04.294289 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.294274 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 17:29:04.294422 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.294405 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 17:29:04.296128 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.296104 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 17:29:04.299094 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.299076 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 17:29:04.303783 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.303762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:29:04.359881 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.359852 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63630436-a757-4050-8388-898a4783f7c4" path="/var/lib/kubelet/pods/63630436-a757-4050-8388-898a4783f7c4/volumes" Jul 21 17:29:04.377222 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377222 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c4d1be4-5610-4bef-ad7f-880738b64713-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377406 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377406 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377406 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377406 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-config\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzp6z\" (UniqueName: \"kubernetes.io/projected/0c4d1be4-5610-4bef-ad7f-880738b64713-kube-api-access-qzp6z\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377703 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377534 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377703 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377703 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377703 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377703 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377858 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377858 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377858 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c4d1be4-5610-4bef-ad7f-880738b64713-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.377858 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.377825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479185 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479185 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479439 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479439 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479439 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479439 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c4d1be4-5610-4bef-ad7f-880738b64713-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479439 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479439 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c4d1be4-5610-4bef-ad7f-880738b64713-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-config\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479634 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.479737 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.480163 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.480163 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzp6z\" (UniqueName: \"kubernetes.io/projected/0c4d1be4-5610-4bef-ad7f-880738b64713-kube-api-access-qzp6z\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.480163 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.480163 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.480163 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.479946 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.480163 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.480015 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.480461 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.480197 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.480519 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.480480 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.481127 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.481102 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.481127 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.481119 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.482438 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.482413 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c4d1be4-5610-4bef-ad7f-880738b64713-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.482536 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.482475 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c4d1be4-5610-4bef-ad7f-880738b64713-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.483880 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.482917 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.483880 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.483381 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.483880 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.483813 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.484081 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.483934 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.484142 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.484102 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.484762 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.484735 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.485360 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.485336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.485658 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.485640 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-config\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.485736 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.485667 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c4d1be4-5610-4bef-ad7f-880738b64713-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.486154 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.486134 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c4d1be4-5610-4bef-ad7f-880738b64713-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.490709 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.490689 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzp6z\" (UniqueName: \"kubernetes.io/projected/0c4d1be4-5610-4bef-ad7f-880738b64713-kube-api-access-qzp6z\") pod \"prometheus-k8s-0\" (UID: \"0c4d1be4-5610-4bef-ad7f-880738b64713\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.599711 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.599682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:29:04.742676 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:04.742644 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 17:29:04.745331 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:29:04.745304 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4d1be4_5610_4bef_ad7f_880738b64713.slice/crio-0a0a83c08d875fd3d8dccc90876434d28b91f6487c6943f09be9d9ba35acc11f WatchSource:0}: Error finding container 0a0a83c08d875fd3d8dccc90876434d28b91f6487c6943f09be9d9ba35acc11f: Status 404 returned error can't find the container with id 0a0a83c08d875fd3d8dccc90876434d28b91f6487c6943f09be9d9ba35acc11f Jul 21 17:29:05.235725 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:05.235687 2562 generic.go:356] "Generic (PLEG): container finished" podID="0c4d1be4-5610-4bef-ad7f-880738b64713" containerID="18ed850387f095336d4501bb43b9981e1a93b0d60def7011d074ad93be6c405d" exitCode=0 Jul 21 17:29:05.236117 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:05.235743 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c4d1be4-5610-4bef-ad7f-880738b64713","Type":"ContainerDied","Data":"18ed850387f095336d4501bb43b9981e1a93b0d60def7011d074ad93be6c405d"} Jul 21 17:29:05.236117 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:05.235794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c4d1be4-5610-4bef-ad7f-880738b64713","Type":"ContainerStarted","Data":"0a0a83c08d875fd3d8dccc90876434d28b91f6487c6943f09be9d9ba35acc11f"} Jul 21 17:29:06.242839 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:06.242800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c4d1be4-5610-4bef-ad7f-880738b64713","Type":"ContainerStarted","Data":"cb87caee193b44c1c77c773f65b372adbe75c1eb59c8e24047f7c3d30851a505"} Jul 21 17:29:06.243253 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:06.242897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c4d1be4-5610-4bef-ad7f-880738b64713","Type":"ContainerStarted","Data":"1e8388a7fe7aa7fcb7245db381ce26f7b92e348175812b7d04999b4736c504b2"} Jul 21 17:29:06.243253 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:06.242922 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c4d1be4-5610-4bef-ad7f-880738b64713","Type":"ContainerStarted","Data":"94775c4827aec83618a66d86ba608954cf493dbad3ece53009a1f50f6a0170d2"} Jul 21 17:29:06.243253 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:06.242946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c4d1be4-5610-4bef-ad7f-880738b64713","Type":"ContainerStarted","Data":"42677b4de4d55f117dd503cebea0309b79914a9b98457d5f1bc753d90417ffa6"} Jul 21 17:29:06.243253 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:06.242974 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c4d1be4-5610-4bef-ad7f-880738b64713","Type":"ContainerStarted","Data":"0e8012b207f59d61e75aeae77b88403bda9a42686f056e8064ed28b142da09c7"} Jul 21 17:29:06.243253 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:06.243001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c4d1be4-5610-4bef-ad7f-880738b64713","Type":"ContainerStarted","Data":"2fdd386833d10975ff90a9f99912a85098b3ad18629c7198253bcf42a2e880c4"} Jul 21 17:29:06.273180 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:06.273126 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.253434674 podStartE2EDuration="2.27310882s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.674146ms" isStatefulPod=false podCreationTimestamp="2026-07-21 17:29:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:29:06.270578927 +0000 UTC m=+170.456583810" watchObservedRunningTime="2026-07-21 17:29:06.27310882 +0000 UTC m=+170.459113701" Jul 21 17:29:09.600379 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:29:09.600333 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:30:04.600653 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:30:04.600609 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:30:04.616547 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:30:04.616521 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:30:05.492863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:30:05.492836 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 17:31:16.197033 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:31:16.196988 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:31:16.200645 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:31:16.200625 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 17:31:16.203138 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:31:16.203118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:33:50.413681 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.413650 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-8rx2v"] Jul 21 17:33:50.416806 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.416784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8rx2v" Jul 21 17:33:50.419624 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.419602 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 21 17:33:50.419729 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.419603 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 21 17:33:50.420504 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.420486 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 21 17:33:50.420613 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.420486 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-ckl7w\"" Jul 21 17:33:50.426413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.426390 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-8rx2v"] Jul 21 17:33:50.473246 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.473204 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/014d50b4-9726-4a0d-a102-d1233e42b93e-model-cache\") pod \"s3-init-8rx2v\" (UID: \"014d50b4-9726-4a0d-a102-d1233e42b93e\") " pod="kserve/s3-init-8rx2v" Jul 21 17:33:50.473425 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.473346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsd62\" (UniqueName: \"kubernetes.io/projected/014d50b4-9726-4a0d-a102-d1233e42b93e-kube-api-access-tsd62\") pod \"s3-init-8rx2v\" (UID: \"014d50b4-9726-4a0d-a102-d1233e42b93e\") " pod="kserve/s3-init-8rx2v" Jul 21 17:33:50.573787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.573747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsd62\" (UniqueName: \"kubernetes.io/projected/014d50b4-9726-4a0d-a102-d1233e42b93e-kube-api-access-tsd62\") pod \"s3-init-8rx2v\" (UID: \"014d50b4-9726-4a0d-a102-d1233e42b93e\") " pod="kserve/s3-init-8rx2v" Jul 21 17:33:50.573787 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.573787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/014d50b4-9726-4a0d-a102-d1233e42b93e-model-cache\") pod \"s3-init-8rx2v\" (UID: \"014d50b4-9726-4a0d-a102-d1233e42b93e\") " pod="kserve/s3-init-8rx2v" Jul 21 17:33:50.574148 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.574133 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/014d50b4-9726-4a0d-a102-d1233e42b93e-model-cache\") pod \"s3-init-8rx2v\" (UID: \"014d50b4-9726-4a0d-a102-d1233e42b93e\") " pod="kserve/s3-init-8rx2v" Jul 21 17:33:50.582831 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.582806 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsd62\" (UniqueName: \"kubernetes.io/projected/014d50b4-9726-4a0d-a102-d1233e42b93e-kube-api-access-tsd62\") pod \"s3-init-8rx2v\" (UID: \"014d50b4-9726-4a0d-a102-d1233e42b93e\") " pod="kserve/s3-init-8rx2v" Jul 21 17:33:50.725810 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.725771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8rx2v" Jul 21 17:33:50.861058 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.860997 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-8rx2v"] Jul 21 17:33:50.863179 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:33:50.863152 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod014d50b4_9726_4a0d_a102_d1233e42b93e.slice/crio-f75e0381afae78117f3e5898a189339998a0c8fc0728398991835dae64c0325b WatchSource:0}: Error finding container f75e0381afae78117f3e5898a189339998a0c8fc0728398991835dae64c0325b: Status 404 returned error can't find the container with id f75e0381afae78117f3e5898a189339998a0c8fc0728398991835dae64c0325b Jul 21 17:33:50.864975 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:50.864959 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 17:33:51.340423 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:51.340391 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8rx2v" event={"ID":"014d50b4-9726-4a0d-a102-d1233e42b93e","Type":"ContainerStarted","Data":"f75e0381afae78117f3e5898a189339998a0c8fc0728398991835dae64c0325b"} Jul 21 17:33:56.364575 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:56.364525 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8rx2v" event={"ID":"014d50b4-9726-4a0d-a102-d1233e42b93e","Type":"ContainerStarted","Data":"657c7748d590a2161e69cebe9605207878bffdc95e56472834256d86c7545f5c"} Jul 21 17:33:58.374173 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:58.374138 2562 generic.go:356] "Generic (PLEG): container finished" podID="014d50b4-9726-4a0d-a102-d1233e42b93e" containerID="657c7748d590a2161e69cebe9605207878bffdc95e56472834256d86c7545f5c" exitCode=0 Jul 21 17:33:58.374577 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:33:58.374209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8rx2v" event={"ID":"014d50b4-9726-4a0d-a102-d1233e42b93e","Type":"ContainerDied","Data":"657c7748d590a2161e69cebe9605207878bffdc95e56472834256d86c7545f5c"} Jul 21 17:34:03.398277 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:34:03.398242 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8rx2v" event={"ID":"014d50b4-9726-4a0d-a102-d1233e42b93e","Type":"ContainerStarted","Data":"87f3defda5d813eb5be9ce24a56cd8ec595fe18ce9fa8d0e7b11d864e2a497e6"} Jul 21 17:34:03.417670 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:34:03.417610 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-8rx2v" podStartSLOduration=2.328072853 podStartE2EDuration="13.417592692s" totalImagesPullingTime="9.15449668s" totalInitContainerRuntime="1.935023159s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:33:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:34:03.416692218 +0000 UTC m=+467.602697100" watchObservedRunningTime="2026-07-21 17:34:03.417592692 +0000 UTC m=+467.603597572" Jul 21 17:35:08.650923 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:08.650889 2562 generic.go:356] "Generic (PLEG): container finished" podID="014d50b4-9726-4a0d-a102-d1233e42b93e" containerID="87f3defda5d813eb5be9ce24a56cd8ec595fe18ce9fa8d0e7b11d864e2a497e6" exitCode=0 Jul 21 17:35:08.651329 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:08.650930 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8rx2v" event={"ID":"014d50b4-9726-4a0d-a102-d1233e42b93e","Type":"ContainerDied","Data":"87f3defda5d813eb5be9ce24a56cd8ec595fe18ce9fa8d0e7b11d864e2a497e6"} Jul 21 17:35:09.783296 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:09.783274 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8rx2v" Jul 21 17:35:09.867342 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:09.867304 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/014d50b4-9726-4a0d-a102-d1233e42b93e-model-cache\") pod \"014d50b4-9726-4a0d-a102-d1233e42b93e\" (UID: \"014d50b4-9726-4a0d-a102-d1233e42b93e\") " Jul 21 17:35:09.867523 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:09.867370 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsd62\" (UniqueName: \"kubernetes.io/projected/014d50b4-9726-4a0d-a102-d1233e42b93e-kube-api-access-tsd62\") pod \"014d50b4-9726-4a0d-a102-d1233e42b93e\" (UID: \"014d50b4-9726-4a0d-a102-d1233e42b93e\") " Jul 21 17:35:09.869720 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:09.869693 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/014d50b4-9726-4a0d-a102-d1233e42b93e-kube-api-access-tsd62" (OuterVolumeSpecName: "kube-api-access-tsd62") pod "014d50b4-9726-4a0d-a102-d1233e42b93e" (UID: "014d50b4-9726-4a0d-a102-d1233e42b93e"). InnerVolumeSpecName "kube-api-access-tsd62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:35:09.889870 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:09.889833 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/014d50b4-9726-4a0d-a102-d1233e42b93e-model-cache" (OuterVolumeSpecName: "model-cache") pod "014d50b4-9726-4a0d-a102-d1233e42b93e" (UID: "014d50b4-9726-4a0d-a102-d1233e42b93e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:35:09.968317 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:09.968281 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsd62\" (UniqueName: \"kubernetes.io/projected/014d50b4-9726-4a0d-a102-d1233e42b93e-kube-api-access-tsd62\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:35:09.968317 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:09.968314 2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/014d50b4-9726-4a0d-a102-d1233e42b93e-model-cache\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:35:10.659922 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:10.659834 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-8rx2v" Jul 21 17:35:10.659922 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:10.659841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-8rx2v" event={"ID":"014d50b4-9726-4a0d-a102-d1233e42b93e","Type":"ContainerDied","Data":"f75e0381afae78117f3e5898a189339998a0c8fc0728398991835dae64c0325b"} Jul 21 17:35:10.659922 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:35:10.659883 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f75e0381afae78117f3e5898a189339998a0c8fc0728398991835dae64c0325b" Jul 21 17:36:16.228053 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:36:16.228023 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:36:16.229300 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:36:16.229277 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:39:08.567396 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.567356 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98"] Jul 21 17:39:08.567900 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.567728 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="014d50b4-9726-4a0d-a102-d1233e42b93e" containerName="download-hf-model" Jul 21 17:39:08.567900 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.567740 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="014d50b4-9726-4a0d-a102-d1233e42b93e" containerName="download-hf-model" Jul 21 17:39:08.567900 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.567748 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="014d50b4-9726-4a0d-a102-d1233e42b93e" containerName="s3-init" Jul 21 17:39:08.567900 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.567754 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="014d50b4-9726-4a0d-a102-d1233e42b93e" containerName="s3-init" Jul 21 17:39:08.567900 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.567815 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="014d50b4-9726-4a0d-a102-d1233e42b93e" containerName="s3-init" Jul 21 17:39:08.570837 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.570816 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.573207 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.573184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-2v5wd\"" Jul 21 17:39:08.573421 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.573406 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 21 17:39:08.573511 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.573462 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 21 17:39:08.574163 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.574134 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-3ad06-predictor-serving-cert\"" Jul 21 17:39:08.574163 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.574136 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-3ad06-kube-rbac-proxy-sar-config\"" Jul 21 17:39:08.574296 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.574141 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 21 17:39:08.574296 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.574243 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 21 17:39:08.583434 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.583401 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98"] Jul 21 17:39:08.657930 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.657877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.658125 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.657995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.658125 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.658041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d061a8db-98da-4a79-a3e6-e9a24df6ec04-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.658125 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.658085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.658338 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.658180 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22jx8\" (UniqueName: \"kubernetes.io/projected/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-api-access-22jx8\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.758995 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.758955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d061a8db-98da-4a79-a3e6-e9a24df6ec04-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.759188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.759016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.759188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.759063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22jx8\" (UniqueName: \"kubernetes.io/projected/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-api-access-22jx8\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.759188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.759105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.759188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.759170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.759543 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.759518 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.759894 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.759873 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.759981 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.759961 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.761642 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.761618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d061a8db-98da-4a79-a3e6-e9a24df6ec04-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.767876 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.767852 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22jx8\" (UniqueName: \"kubernetes.io/projected/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-api-access-22jx8\") pod \"isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:08.881995 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:08.881907 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:09.019286 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:09.019260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98"] Jul 21 17:39:09.021204 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:39:09.021176 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd061a8db_98da_4a79_a3e6_e9a24df6ec04.slice/crio-a1e472878e21d151e114e464cca0e293c4f005f9fb920b2af046a20150de48d7 WatchSource:0}: Error finding container a1e472878e21d151e114e464cca0e293c4f005f9fb920b2af046a20150de48d7: Status 404 returned error can't find the container with id a1e472878e21d151e114e464cca0e293c4f005f9fb920b2af046a20150de48d7 Jul 21 17:39:09.596503 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:09.596465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" event={"ID":"d061a8db-98da-4a79-a3e6-e9a24df6ec04","Type":"ContainerStarted","Data":"1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c"} Jul 21 17:39:09.596938 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:09.596546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" event={"ID":"d061a8db-98da-4a79-a3e6-e9a24df6ec04","Type":"ContainerStarted","Data":"a1e472878e21d151e114e464cca0e293c4f005f9fb920b2af046a20150de48d7"} Jul 21 17:39:13.615154 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:13.615119 2562 generic.go:356] "Generic (PLEG): container finished" podID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerID="1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c" exitCode=0 Jul 21 17:39:13.615669 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:13.615178 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" event={"ID":"d061a8db-98da-4a79-a3e6-e9a24df6ec04","Type":"ContainerDied","Data":"1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c"} Jul 21 17:39:13.616610 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:13.616593 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 17:39:32.709965 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:32.709928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" event={"ID":"d061a8db-98da-4a79-a3e6-e9a24df6ec04","Type":"ContainerStarted","Data":"0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8"} Jul 21 17:39:35.725822 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:35.725769 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" event={"ID":"d061a8db-98da-4a79-a3e6-e9a24df6ec04","Type":"ContainerStarted","Data":"f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6"} Jul 21 17:39:35.726451 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:35.726426 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:35.748374 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:35.748324 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podStartSLOduration=3.052785319 podStartE2EDuration="27.748308267s" totalImagesPullingTime="21.14395734s" totalInitContainerRuntime="3.551565608s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:39:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:39:35.747071049 +0000 UTC m=+799.933075929" watchObservedRunningTime="2026-07-21 17:39:35.748308267 +0000 UTC m=+799.934313147" Jul 21 17:39:36.730577 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:36.730457 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:36.731943 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:36.731905 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Jul 21 17:39:37.737880 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:37.737838 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Jul 21 17:39:42.742181 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:42.742152 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:39:42.742854 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:42.742826 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Jul 21 17:39:52.743037 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:39:52.742990 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Jul 21 17:40:02.743503 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:02.743465 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Jul 21 17:40:12.742917 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:12.742877 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Jul 21 17:40:22.743602 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:22.743537 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Jul 21 17:40:32.744232 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:32.744196 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:40:58.942901 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:58.942870 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98"] Jul 21 17:40:58.943658 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:58.943122 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" containerID="cri-o://0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8" gracePeriod=30 Jul 21 17:40:58.943658 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:58.943164 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kube-rbac-proxy" containerID="cri-o://f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6" gracePeriod=30 Jul 21 17:40:59.061484 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:59.061456 2562 generic.go:356] "Generic (PLEG): container finished" podID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerID="f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6" exitCode=2 Jul 21 17:40:59.061658 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:40:59.061507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" event={"ID":"d061a8db-98da-4a79-a3e6-e9a24df6ec04","Type":"ContainerDied","Data":"f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6"} Jul 21 17:41:02.486513 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.486490 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:41:02.538941 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.538912 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d061a8db-98da-4a79-a3e6-e9a24df6ec04-proxy-tls\") pod \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " Jul 21 17:41:02.538941 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.538946 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22jx8\" (UniqueName: \"kubernetes.io/projected/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-api-access-22jx8\") pod \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " Jul 21 17:41:02.539182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.538977 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-rbac-proxy-sar-config\") pod \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " Jul 21 17:41:02.539182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.539010 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-cabundle-cert\") pod \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " Jul 21 17:41:02.539182 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.539065 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kserve-provision-location\") pod \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\" (UID: \"d061a8db-98da-4a79-a3e6-e9a24df6ec04\") " Jul 21 17:41:02.539408 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.539380 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d061a8db-98da-4a79-a3e6-e9a24df6ec04" (UID: "d061a8db-98da-4a79-a3e6-e9a24df6ec04"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:41:02.539486 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.539402 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d061a8db-98da-4a79-a3e6-e9a24df6ec04" (UID: "d061a8db-98da-4a79-a3e6-e9a24df6ec04"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 17:41:02.539486 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.539463 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d061a8db-98da-4a79-a3e6-e9a24df6ec04" (UID: "d061a8db-98da-4a79-a3e6-e9a24df6ec04"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:41:02.541944 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.541920 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-api-access-22jx8" (OuterVolumeSpecName: "kube-api-access-22jx8") pod "d061a8db-98da-4a79-a3e6-e9a24df6ec04" (UID: "d061a8db-98da-4a79-a3e6-e9a24df6ec04"). InnerVolumeSpecName "kube-api-access-22jx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:41:02.542068 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.542033 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d061a8db-98da-4a79-a3e6-e9a24df6ec04-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d061a8db-98da-4a79-a3e6-e9a24df6ec04" (UID: "d061a8db-98da-4a79-a3e6-e9a24df6ec04"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 17:41:02.639820 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.639743 2562 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kserve-provision-location\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:41:02.639820 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.639768 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d061a8db-98da-4a79-a3e6-e9a24df6ec04-proxy-tls\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:41:02.639820 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.639779 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22jx8\" (UniqueName: \"kubernetes.io/projected/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-api-access-22jx8\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:41:02.639820 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.639789 2562 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:41:02.639820 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:02.639798 2562 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d061a8db-98da-4a79-a3e6-e9a24df6ec04-cabundle-cert\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:41:03.081320 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.081287 2562 generic.go:356] "Generic (PLEG): container finished" podID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerID="0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8" exitCode=0 Jul 21 17:41:03.081474 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.081319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" event={"ID":"d061a8db-98da-4a79-a3e6-e9a24df6ec04","Type":"ContainerDied","Data":"0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8"} Jul 21 17:41:03.081474 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.081348 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" Jul 21 17:41:03.081474 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.081389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98" event={"ID":"d061a8db-98da-4a79-a3e6-e9a24df6ec04","Type":"ContainerDied","Data":"a1e472878e21d151e114e464cca0e293c4f005f9fb920b2af046a20150de48d7"} Jul 21 17:41:03.081474 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.081417 2562 scope.go:117] "RemoveContainer" containerID="f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6" Jul 21 17:41:03.090392 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.090371 2562 scope.go:117] "RemoveContainer" containerID="0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8" Jul 21 17:41:03.098257 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.098238 2562 scope.go:117] "RemoveContainer" containerID="1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c" Jul 21 17:41:03.105898 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.105868 2562 scope.go:117] "RemoveContainer" containerID="f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6" Jul 21 17:41:03.106204 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:41:03.106177 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6\": container with ID starting with f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6 not found: ID does not exist" containerID="f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6" Jul 21 17:41:03.106259 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.106216 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6"} err="failed to get container status \"f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6\": rpc error: code = NotFound desc = could not find container \"f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6\": container with ID starting with f0dd62f96026774295c4c650daa717e072ebda411c79f382b6db3320373567c6 not found: ID does not exist" Jul 21 17:41:03.106259 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.106241 2562 scope.go:117] "RemoveContainer" containerID="0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8" Jul 21 17:41:03.106461 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:41:03.106441 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8\": container with ID starting with 0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8 not found: ID does not exist" containerID="0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8" Jul 21 17:41:03.106525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.106462 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98"] Jul 21 17:41:03.106525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.106471 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8"} err="failed to get container status \"0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8\": rpc error: code = NotFound desc = could not find container \"0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8\": container with ID starting with 0b3e1d9698f70d6e58b1b3de26a26e837df1d66c6c80d4d43f85f906ed9687d8 not found: ID does not exist" Jul 21 17:41:03.106525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.106495 2562 scope.go:117] "RemoveContainer" containerID="1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c" Jul 21 17:41:03.106746 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:41:03.106731 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c\": container with ID starting with 1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c not found: ID does not exist" containerID="1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c" Jul 21 17:41:03.106789 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.106751 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c"} err="failed to get container status \"1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c\": rpc error: code = NotFound desc = could not find container \"1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c\": container with ID starting with 1e76943a988b5ca2c3a075c7f4a3765f933cf573560e0b28c0a7c4937279163c not found: ID does not exist" Jul 21 17:41:03.110100 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:03.110080 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-3ad06-predictor-dc9c5c7fc-zph98"] Jul 21 17:41:04.358973 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:04.358940 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" path="/var/lib/kubelet/pods/d061a8db-98da-4a79-a3e6-e9a24df6ec04/volumes" Jul 21 17:41:16.256109 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:16.256026 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:41:16.256887 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:41:16.256863 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:46:16.280915 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:46:16.280888 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:46:16.281516 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:46:16.281380 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:51:03.311672 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.311634 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zlfqq/must-gather-rg79h"] Jul 21 17:51:03.312107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.311954 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="storage-initializer" Jul 21 17:51:03.312107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.311964 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="storage-initializer" Jul 21 17:51:03.312107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.311973 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" Jul 21 17:51:03.312107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.311979 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" Jul 21 17:51:03.312107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.311985 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kube-rbac-proxy" Jul 21 17:51:03.312107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.311990 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kube-rbac-proxy" Jul 21 17:51:03.312107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.312041 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kube-rbac-proxy" Jul 21 17:51:03.312107 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.312051 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d061a8db-98da-4a79-a3e6-e9a24df6ec04" containerName="kserve-container" Jul 21 17:51:03.315153 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.315137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:03.317772 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.317750 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zlfqq\"/\"kube-root-ca.crt\"" Jul 21 17:51:03.317881 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.317789 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zlfqq\"/\"openshift-service-ca.crt\"" Jul 21 17:51:03.317881 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.317824 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zlfqq\"/\"default-dockercfg-nc6wj\"" Jul 21 17:51:03.323076 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.323053 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zlfqq/must-gather-rg79h"] Jul 21 17:51:03.353315 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.353286 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7798\" (UniqueName: \"kubernetes.io/projected/47defe50-f78d-4221-b344-14fe5f784124-kube-api-access-l7798\") pod \"must-gather-rg79h\" (UID: \"47defe50-f78d-4221-b344-14fe5f784124\") " pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:03.353484 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.353358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47defe50-f78d-4221-b344-14fe5f784124-must-gather-output\") pod \"must-gather-rg79h\" (UID: \"47defe50-f78d-4221-b344-14fe5f784124\") " pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:03.454048 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.454016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47defe50-f78d-4221-b344-14fe5f784124-must-gather-output\") pod \"must-gather-rg79h\" (UID: \"47defe50-f78d-4221-b344-14fe5f784124\") " pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:03.454223 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.454075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7798\" (UniqueName: \"kubernetes.io/projected/47defe50-f78d-4221-b344-14fe5f784124-kube-api-access-l7798\") pod \"must-gather-rg79h\" (UID: \"47defe50-f78d-4221-b344-14fe5f784124\") " pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:03.454353 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.454334 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47defe50-f78d-4221-b344-14fe5f784124-must-gather-output\") pod \"must-gather-rg79h\" (UID: \"47defe50-f78d-4221-b344-14fe5f784124\") " pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:03.462530 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.462509 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7798\" (UniqueName: \"kubernetes.io/projected/47defe50-f78d-4221-b344-14fe5f784124-kube-api-access-l7798\") pod \"must-gather-rg79h\" (UID: \"47defe50-f78d-4221-b344-14fe5f784124\") " pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:03.625222 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.625139 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:03.755394 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.755370 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zlfqq/must-gather-rg79h"] Jul 21 17:51:03.757353 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:51:03.757328 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47defe50_f78d_4221_b344_14fe5f784124.slice/crio-05c32f44af2af313ae8be5fdb5a1870b2f1f6d967750e70e1508f1f7eceb1116 WatchSource:0}: Error finding container 05c32f44af2af313ae8be5fdb5a1870b2f1f6d967750e70e1508f1f7eceb1116: Status 404 returned error can't find the container with id 05c32f44af2af313ae8be5fdb5a1870b2f1f6d967750e70e1508f1f7eceb1116 Jul 21 17:51:03.759159 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:03.759143 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 17:51:04.457288 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:04.457254 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zlfqq/must-gather-rg79h" event={"ID":"47defe50-f78d-4221-b344-14fe5f784124","Type":"ContainerStarted","Data":"05c32f44af2af313ae8be5fdb5a1870b2f1f6d967750e70e1508f1f7eceb1116"} Jul 21 17:51:10.489162 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:10.489123 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zlfqq/must-gather-rg79h" event={"ID":"47defe50-f78d-4221-b344-14fe5f784124","Type":"ContainerStarted","Data":"a90a5ae992ce3e313a434d885b62d4b4676712eec7b5c03fa10a61cb524fc148"} Jul 21 17:51:10.489638 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:10.489172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zlfqq/must-gather-rg79h" event={"ID":"47defe50-f78d-4221-b344-14fe5f784124","Type":"ContainerStarted","Data":"e95999619dbb622cee441e1617c151d2896aa15ecaabd62e82da3d87dda15bb4"} Jul 21 17:51:10.507687 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:10.507626 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zlfqq/must-gather-rg79h" podStartSLOduration=1.229590861 podStartE2EDuration="7.507603542s" totalImagesPullingTime="6.278012681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:51:10.506086494 +0000 UTC m=+1494.692091375" watchObservedRunningTime="2026-07-21 17:51:10.507603542 +0000 UTC m=+1494.693608422" Jul 21 17:51:16.313656 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:16.313628 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:51:16.313656 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:16.313637 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:51:28.570712 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:28.570681 2562 generic.go:356] "Generic (PLEG): container finished" podID="47defe50-f78d-4221-b344-14fe5f784124" containerID="e95999619dbb622cee441e1617c151d2896aa15ecaabd62e82da3d87dda15bb4" exitCode=0 Jul 21 17:51:28.571140 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:28.570762 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zlfqq/must-gather-rg79h" event={"ID":"47defe50-f78d-4221-b344-14fe5f784124","Type":"ContainerDied","Data":"e95999619dbb622cee441e1617c151d2896aa15ecaabd62e82da3d87dda15bb4"} Jul 21 17:51:28.571140 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:28.571101 2562 scope.go:117] "RemoveContainer" containerID="e95999619dbb622cee441e1617c151d2896aa15ecaabd62e82da3d87dda15bb4" Jul 21 17:51:28.967716 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:28.967690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zlfqq_must-gather-rg79h_47defe50-f78d-4221-b344-14fe5f784124/gather/0.log" Jul 21 17:51:32.164729 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:32.164698 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fzpvb_d7b623b7-e33c-4b70-9582-362854fe68aa/global-pull-secret-syncer/0.log" Jul 21 17:51:32.376828 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:32.376797 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vvld2_a1e145bb-4282-4a1a-b554-e1906e78e23b/konnectivity-agent/0.log" Jul 21 17:51:32.449228 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:32.449142 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-6.ec2.internal_0f85b59baa01cccdade8441c60510cd6/haproxy/0.log" Jul 21 17:51:34.360166 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.360129 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-zlfqq/must-gather-rg79h"] Jul 21 17:51:34.360676 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.360326 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-zlfqq/must-gather-rg79h" podUID="47defe50-f78d-4221-b344-14fe5f784124" containerName="copy" containerID="cri-o://a90a5ae992ce3e313a434d885b62d4b4676712eec7b5c03fa10a61cb524fc148" gracePeriod=2 Jul 21 17:51:34.361172 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.361149 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-zlfqq/must-gather-rg79h"] Jul 21 17:51:34.362473 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:51:34.362438 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rg79h\" is forbidden: User \"system:node:ip-10-0-139-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zlfqq\": no relationship found between node 'ip-10-0-139-6.ec2.internal' and this object" podUID="47defe50-f78d-4221-b344-14fe5f784124" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:34.596378 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.596354 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zlfqq_must-gather-rg79h_47defe50-f78d-4221-b344-14fe5f784124/copy/0.log" Jul 21 17:51:34.596805 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.596780 2562 generic.go:356] "Generic (PLEG): container finished" podID="47defe50-f78d-4221-b344-14fe5f784124" containerID="a90a5ae992ce3e313a434d885b62d4b4676712eec7b5c03fa10a61cb524fc148" exitCode=143 Jul 21 17:51:34.596882 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.596860 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05c32f44af2af313ae8be5fdb5a1870b2f1f6d967750e70e1508f1f7eceb1116" Jul 21 17:51:34.601230 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.601215 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-zlfqq_must-gather-rg79h_47defe50-f78d-4221-b344-14fe5f784124/copy/0.log" Jul 21 17:51:34.602883 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.602865 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:34.605047 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:51:34.605023 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rg79h\" is forbidden: User \"system:node:ip-10-0-139-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zlfqq\": no relationship found between node 'ip-10-0-139-6.ec2.internal' and this object" podUID="47defe50-f78d-4221-b344-14fe5f784124" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:34.639064 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.638990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7798\" (UniqueName: \"kubernetes.io/projected/47defe50-f78d-4221-b344-14fe5f784124-kube-api-access-l7798\") pod \"47defe50-f78d-4221-b344-14fe5f784124\" (UID: \"47defe50-f78d-4221-b344-14fe5f784124\") " Jul 21 17:51:34.639064 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.639033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47defe50-f78d-4221-b344-14fe5f784124-must-gather-output\") pod \"47defe50-f78d-4221-b344-14fe5f784124\" (UID: \"47defe50-f78d-4221-b344-14fe5f784124\") " Jul 21 17:51:34.640408 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.640384 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47defe50-f78d-4221-b344-14fe5f784124-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "47defe50-f78d-4221-b344-14fe5f784124" (UID: "47defe50-f78d-4221-b344-14fe5f784124"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 17:51:34.641197 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.641178 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47defe50-f78d-4221-b344-14fe5f784124-kube-api-access-l7798" (OuterVolumeSpecName: "kube-api-access-l7798") pod "47defe50-f78d-4221-b344-14fe5f784124" (UID: "47defe50-f78d-4221-b344-14fe5f784124"). InnerVolumeSpecName "kube-api-access-l7798". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 17:51:34.740204 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.740173 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7798\" (UniqueName: \"kubernetes.io/projected/47defe50-f78d-4221-b344-14fe5f784124-kube-api-access-l7798\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:51:34.740204 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:34.740199 2562 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47defe50-f78d-4221-b344-14fe5f784124-must-gather-output\") on node \"ip-10-0-139-6.ec2.internal\" DevicePath \"\"" Jul 21 17:51:35.600919 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:35.600886 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:35.603362 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:51:35.603320 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rg79h\" is forbidden: User \"system:node:ip-10-0-139-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zlfqq\": no relationship found between node 'ip-10-0-139-6.ec2.internal' and this object" podUID="47defe50-f78d-4221-b344-14fe5f784124" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:35.610641 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:51:35.610616 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rg79h\" is forbidden: User \"system:node:ip-10-0-139-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zlfqq\": no relationship found between node 'ip-10-0-139-6.ec2.internal' and this object" podUID="47defe50-f78d-4221-b344-14fe5f784124" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:36.358185 ip-10-0-139-6 kubenswrapper[2562]: E0721 17:51:36.358075 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-rg79h\" is forbidden: User \"system:node:ip-10-0-139-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-zlfqq\": no relationship found between node 'ip-10-0-139-6.ec2.internal' and this object" podUID="47defe50-f78d-4221-b344-14fe5f784124" pod="openshift-must-gather-zlfqq/must-gather-rg79h" Jul 21 17:51:36.358850 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:36.358830 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47defe50-f78d-4221-b344-14fe5f784124" path="/var/lib/kubelet/pods/47defe50-f78d-4221-b344-14fe5f784124/volumes" Jul 21 17:51:36.734805 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:36.734778 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-g6f7l_94e4de6b-9099-4e65-8731-d9049564048c/kube-state-metrics/0.log" Jul 21 17:51:36.758680 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:36.758658 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-g6f7l_94e4de6b-9099-4e65-8731-d9049564048c/kube-rbac-proxy-main/0.log" Jul 21 17:51:36.782465 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:36.782443 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-g6f7l_94e4de6b-9099-4e65-8731-d9049564048c/kube-rbac-proxy-self/0.log" Jul 21 17:51:36.813156 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:36.813135 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-98c8c4c6b-spz5p_4c2f821f-a9de-4ef9-ae3c-918bc020028f/metrics-server/0.log" Jul 21 17:51:37.046732 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.046658 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qnf2s_0ced24b5-5f05-456a-9daa-98ac981d4ced/node-exporter/0.log" Jul 21 17:51:37.069741 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.069714 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qnf2s_0ced24b5-5f05-456a-9daa-98ac981d4ced/kube-rbac-proxy/0.log" Jul 21 17:51:37.093830 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.093809 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qnf2s_0ced24b5-5f05-456a-9daa-98ac981d4ced/init-textfile/0.log" Jul 21 17:51:37.221600 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.221573 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c4d1be4-5610-4bef-ad7f-880738b64713/prometheus/0.log" Jul 21 17:51:37.246205 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.246176 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c4d1be4-5610-4bef-ad7f-880738b64713/config-reloader/0.log" Jul 21 17:51:37.271188 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.271168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c4d1be4-5610-4bef-ad7f-880738b64713/thanos-sidecar/0.log" Jul 21 17:51:37.300906 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.300832 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c4d1be4-5610-4bef-ad7f-880738b64713/kube-rbac-proxy-web/0.log" Jul 21 17:51:37.330078 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.330057 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c4d1be4-5610-4bef-ad7f-880738b64713/kube-rbac-proxy/0.log" Jul 21 17:51:37.353868 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.353848 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c4d1be4-5610-4bef-ad7f-880738b64713/kube-rbac-proxy-thanos/0.log" Jul 21 17:51:37.376496 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.376475 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c4d1be4-5610-4bef-ad7f-880738b64713/init-config-reloader/0.log" Jul 21 17:51:37.463579 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.463526 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-h29bz_eeed0d25-75fc-4367-aa35-ba8618b3d454/prometheus-operator-admission-webhook/0.log" Jul 21 17:51:37.505640 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.505616 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-754fb5fcdf-lhvq7_ea302c6e-07d5-43e0-a395-dc574f18e4c3/telemeter-client/0.log" Jul 21 17:51:37.530427 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.530398 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-754fb5fcdf-lhvq7_ea302c6e-07d5-43e0-a395-dc574f18e4c3/reload/0.log" Jul 21 17:51:37.553414 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.553348 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-754fb5fcdf-lhvq7_ea302c6e-07d5-43e0-a395-dc574f18e4c3/kube-rbac-proxy/0.log" Jul 21 17:51:37.587881 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.587856 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7754694b46-4dlxv_d41d5157-3f71-4341-b773-0ec755edd220/thanos-query/0.log" Jul 21 17:51:37.617724 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.617690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7754694b46-4dlxv_d41d5157-3f71-4341-b773-0ec755edd220/kube-rbac-proxy-web/0.log" Jul 21 17:51:37.646426 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.646405 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7754694b46-4dlxv_d41d5157-3f71-4341-b773-0ec755edd220/kube-rbac-proxy/0.log" Jul 21 17:51:37.668419 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.668395 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7754694b46-4dlxv_d41d5157-3f71-4341-b773-0ec755edd220/prom-label-proxy/0.log" Jul 21 17:51:37.691609 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.691582 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7754694b46-4dlxv_d41d5157-3f71-4341-b773-0ec755edd220/kube-rbac-proxy-rules/0.log" Jul 21 17:51:37.715967 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:37.715948 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7754694b46-4dlxv_d41d5157-3f71-4341-b773-0ec755edd220/kube-rbac-proxy-metrics/0.log" Jul 21 17:51:39.070532 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:39.070456 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-zrfq8_4f150b36-5893-42a7-bc00-3d13184916c8/networking-console-plugin/0.log" Jul 21 17:51:40.399365 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.399322 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5"] Jul 21 17:51:40.399777 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.399704 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47defe50-f78d-4221-b344-14fe5f784124" containerName="copy" Jul 21 17:51:40.399777 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.399716 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="47defe50-f78d-4221-b344-14fe5f784124" containerName="copy" Jul 21 17:51:40.399777 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.399741 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47defe50-f78d-4221-b344-14fe5f784124" containerName="gather" Jul 21 17:51:40.399777 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.399746 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="47defe50-f78d-4221-b344-14fe5f784124" containerName="gather" Jul 21 17:51:40.399914 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.399798 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="47defe50-f78d-4221-b344-14fe5f784124" containerName="gather" Jul 21 17:51:40.399914 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.399810 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="47defe50-f78d-4221-b344-14fe5f784124" containerName="copy" Jul 21 17:51:40.402469 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.402450 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.405036 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.405006 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjhzd\"/\"default-dockercfg-6djp4\"" Jul 21 17:51:40.406204 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.406186 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjhzd\"/\"kube-root-ca.crt\"" Jul 21 17:51:40.406307 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.406202 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjhzd\"/\"openshift-service-ca.crt\"" Jul 21 17:51:40.411226 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.411196 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5"] Jul 21 17:51:40.488042 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.488005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-proc\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.488217 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.488060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-podres\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.488217 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.488153 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-lib-modules\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.488332 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.488218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6b9j\" (UniqueName: \"kubernetes.io/projected/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-kube-api-access-x6b9j\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.488332 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.488298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-sys\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589305 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-proc\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589305 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-podres\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589510 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-proc\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589510 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-lib-modules\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589510 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589502 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-podres\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589638 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589503 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6b9j\" (UniqueName: \"kubernetes.io/projected/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-kube-api-access-x6b9j\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589638 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589605 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-lib-modules\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589638 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-sys\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.589728 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.589693 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-sys\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.597763 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.597735 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6b9j\" (UniqueName: \"kubernetes.io/projected/a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77-kube-api-access-x6b9j\") pod \"perf-node-gather-daemonset-hp2h5\" (UID: \"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77\") " pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.712533 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.712504 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:40.838000 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:40.837967 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5"] Jul 21 17:51:40.840840 ip-10-0-139-6 kubenswrapper[2562]: W0721 17:51:40.840809 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda8f9f6d3_ac9d_4dc6_95f3_e7341328ea77.slice/crio-628571ce28d90ff82dea586e838c41cddddd0eef8ba0fdc6cfc1e5ffecb67dfe WatchSource:0}: Error finding container 628571ce28d90ff82dea586e838c41cddddd0eef8ba0fdc6cfc1e5ffecb67dfe: Status 404 returned error can't find the container with id 628571ce28d90ff82dea586e838c41cddddd0eef8ba0fdc6cfc1e5ffecb67dfe Jul 21 17:51:41.576988 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:41.576944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z57wh_bc1c7421-626d-4e71-acc4-e73e924995dd/dns/0.log" Jul 21 17:51:41.600863 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:41.600817 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z57wh_bc1c7421-626d-4e71-acc4-e73e924995dd/kube-rbac-proxy/0.log" Jul 21 17:51:41.625409 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:41.625386 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9db6r_e5f53e19-4316-4c8c-a739-8d65012a31da/dns-node-resolver/0.log" Jul 21 17:51:41.628938 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:41.628913 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" event={"ID":"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77","Type":"ContainerStarted","Data":"a66529149ecafb9783d081c67180af2772ff368f53a76347532a772474606bfd"} Jul 21 17:51:41.629086 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:41.628961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" event={"ID":"a8f9f6d3-ac9d-4dc6-95f3-e7341328ea77","Type":"ContainerStarted","Data":"628571ce28d90ff82dea586e838c41cddddd0eef8ba0fdc6cfc1e5ffecb67dfe"} Jul 21 17:51:41.629086 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:41.629017 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:41.646478 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:41.646435 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" podStartSLOduration=1.646421507 podStartE2EDuration="1.646421507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:51:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:51:41.645516654 +0000 UTC m=+1525.831521536" watchObservedRunningTime="2026-07-21 17:51:41.646421507 +0000 UTC m=+1525.832426387" Jul 21 17:51:42.125458 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:42.125430 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64f8d6c587-nwnmb_3114e58c-7310-40a3-8ac1-d88648e22f95/registry/0.log" Jul 21 17:51:42.145633 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:42.145605 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gcz99_5e720559-add7-418c-aa6f-4a501dd40de3/node-ca/0.log" Jul 21 17:51:43.232833 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:43.232804 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5c9w4_0e1bfe4d-8e2a-4c07-a9e0-736ee54eeaae/serve-healthcheck-canary/0.log" Jul 21 17:51:43.797959 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:43.797932 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7g9f_ec8cf908-3744-490c-b09e-b61158bbcb8b/kube-rbac-proxy/0.log" Jul 21 17:51:43.819792 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:43.819764 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7g9f_ec8cf908-3744-490c-b09e-b61158bbcb8b/exporter/0.log" Jul 21 17:51:43.843542 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:43.843515 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7g9f_ec8cf908-3744-490c-b09e-b61158bbcb8b/extractor/0.log" Jul 21 17:51:46.250491 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:46.250463 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-8rx2v_014d50b4-9726-4a0d-a102-d1233e42b93e/s3-init/0.log" Jul 21 17:51:46.266562 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:46.266535 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-8rx2v_014d50b4-9726-4a0d-a102-d1233e42b93e/download-hf-model/0.log" Jul 21 17:51:47.645590 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:47.645538 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjhzd/perf-node-gather-daemonset-hp2h5" Jul 21 17:51:50.376135 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:50.376058 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-96bzf_e42ebdff-c5c5-4ff4-aaaf-babe31f300f6/migrator/0.log" Jul 21 17:51:50.399982 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:50.399957 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-96bzf_e42ebdff-c5c5-4ff4-aaaf-babe31f300f6/graceful-termination/0.log" Jul 21 17:51:51.686839 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:51.686759 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6qvds_f928fc1d-da61-440f-a18f-fe4710664556/kube-multus/0.log" Jul 21 17:51:52.048791 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.048766 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fj2lp_5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2/kube-multus-additional-cni-plugins/0.log" Jul 21 17:51:52.070134 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.070113 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fj2lp_5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2/egress-router-binary-copy/0.log" Jul 21 17:51:52.095816 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.095793 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fj2lp_5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2/cni-plugins/0.log" Jul 21 17:51:52.116623 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.116603 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fj2lp_5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2/bond-cni-plugin/0.log" Jul 21 17:51:52.136921 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.136906 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fj2lp_5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2/routeoverride-cni/0.log" Jul 21 17:51:52.157525 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.157505 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fj2lp_5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2/whereabouts-cni-bincopy/0.log" Jul 21 17:51:52.179338 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.179307 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fj2lp_5114d2ef-44c6-4c71-8a6f-f3e2e61f3ae2/whereabouts-cni/0.log" Jul 21 17:51:52.349340 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.349270 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pxxk4_82c06dd5-82f6-44e4-9470-07d3566635b6/network-metrics-daemon/0.log" Jul 21 17:51:52.369713 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:52.369678 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pxxk4_82c06dd5-82f6-44e4-9470-07d3566635b6/kube-rbac-proxy/0.log" Jul 21 17:51:53.123951 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.123922 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-controller/0.log" Jul 21 17:51:53.145413 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.145389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/1.log" Jul 21 17:51:53.145539 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.145466 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovn-acl-logging/0.log" Jul 21 17:51:53.165541 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.165519 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/kube-rbac-proxy-node/0.log" Jul 21 17:51:53.187091 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.187071 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/kube-rbac-proxy-ovn-metrics/0.log" Jul 21 17:51:53.211187 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.211165 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/northd/0.log" Jul 21 17:51:53.233400 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.233367 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/nbdb/0.log" Jul 21 17:51:53.254775 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.254749 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/sbdb/0.log" Jul 21 17:51:53.292741 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:53.292714 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hf7wc_e019c228-bb03-4f81-99ee-d0237aef0e96/ovnkube-controller/0.log" Jul 21 17:51:54.733053 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:54.733021 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-57xw5_5e8db8b1-4276-4eaa-923b-dc316b87f016/network-check-target-container/0.log" Jul 21 17:51:55.661757 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:55.661731 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-s6mtb_40433425-e249-449d-9abe-5999de1a0869/iptables-alerter/0.log" Jul 21 17:51:56.375202 ip-10-0-139-6 kubenswrapper[2562]: I0721 17:51:56.375180 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-vrz7m_ada8b4fc-605a-435a-9c09-00844c9fb938/tuned/0.log"