Jul 28 14:55:18.628725 ip-10-0-129-173 systemd[1]: Starting Kubernetes Kubelet... Jul 28 14:55:19.072915 ip-10-0-129-173 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 14:55:19.072915 ip-10-0-129-173 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 14:55:19.072915 ip-10-0-129-173 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 14:55:19.072915 ip-10-0-129-173 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 14:55:19.072915 ip-10-0-129-173 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 14:55:19.075007 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.074896 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 14:55:19.080089 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080058 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 14:55:19.080089 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080076 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 14:55:19.080089 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080081 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 14:55:19.080089 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080093 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 14:55:19.080089 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080097 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080101 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080105 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080109 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080114 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080118 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080122 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080125 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080129 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080133 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080136 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080140 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080144 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080149 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080153 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080161 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080165 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080169 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080172 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080176 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 14:55:19.080396 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080180 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080184 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080189 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080193 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080196 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080200 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080204 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080208 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080212 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080216 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080220 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080224 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080230 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080236 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080241 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080246 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080251 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080256 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080261 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 14:55:19.081221 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080266 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080270 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080277 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080285 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080290 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080294 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080298 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080303 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080307 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080311 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080315 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080319 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080324 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080328 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080333 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080338 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080342 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080346 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080350 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 14:55:19.082101 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080354 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080358 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080363 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080367 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080374 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080379 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080383 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080388 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080392 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080396 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080401 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080405 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080409 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080414 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080418 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080422 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080426 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080431 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080436 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 14:55:19.082933 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080440 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080458 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080463 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080467 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080471 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080475 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080479 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080483 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080487 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080494 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080500 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080504 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080510 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080514 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080518 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080522 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080526 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.080532 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081694 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081704 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 14:55:19.083773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081709 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081714 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081720 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081726 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081730 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081736 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081743 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081749 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081754 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081760 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081764 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081769 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081773 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081778 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081782 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081787 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081791 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081795 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081799 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 14:55:19.084660 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081803 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081807 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081811 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081815 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081820 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081824 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081828 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081832 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081836 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081841 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081845 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081849 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081854 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081858 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081864 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081869 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081873 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081877 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081882 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081886 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 14:55:19.085149 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081890 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081894 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081898 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081904 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081909 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081915 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081920 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081924 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081928 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081932 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081936 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081941 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081945 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081950 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081954 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081958 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081964 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081968 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081972 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081976 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 14:55:19.085665 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081981 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081985 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081990 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081994 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.081999 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082005 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082009 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082013 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082018 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082022 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082026 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082030 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082035 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082039 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082044 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082048 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082053 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082058 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082062 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082066 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 14:55:19.086195 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082070 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082074 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082078 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082083 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082087 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082091 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082095 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082099 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082104 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082108 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082111 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082115 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082119 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082123 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082130 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082134 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082138 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082145 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082778 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 14:55:19.086716 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082787 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082792 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082797 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082802 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082806 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082811 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082816 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082821 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082826 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082831 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082835 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082839 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082843 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082848 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082853 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082857 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082862 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082867 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082871 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082876 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 14:55:19.087209 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082880 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082884 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082889 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082893 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082898 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082903 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082907 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082916 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082921 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082925 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082930 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082935 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082939 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082943 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082947 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082951 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082955 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082959 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082963 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082968 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 14:55:19.087757 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082972 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082976 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082982 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082987 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082993 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.082999 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083003 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083007 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083012 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083016 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083021 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083025 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083029 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083036 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083042 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083046 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083051 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083056 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083060 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 14:55:19.088310 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083066 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083070 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083074 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083078 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083083 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083087 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083091 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083095 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083099 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083104 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083108 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083112 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083117 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083121 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083125 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083129 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083133 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083138 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083143 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083147 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 14:55:19.088837 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083151 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083155 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083159 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083163 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083167 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083171 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083175 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083183 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083188 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083192 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083197 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083201 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083206 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083210 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083216 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083222 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083226 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083231 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.083235 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083340 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 14:55:19.089333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083357 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083367 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083374 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083381 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083387 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083393 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083400 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083405 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083410 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083416 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083422 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083427 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083432 2561 flags.go:64] FLAG: --cgroup-root="" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083437 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083457 2561 flags.go:64] FLAG: --client-ca-file="" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083462 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083467 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083473 2561 flags.go:64] FLAG: --cluster-domain="" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083478 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083485 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083490 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083496 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083502 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 14:55:19.089837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083507 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083514 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083519 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083525 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083530 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083535 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083541 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083545 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083552 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083557 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083561 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083566 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083571 2561 flags.go:64] FLAG: --enable-server="true" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083575 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083584 2561 flags.go:64] FLAG: --event-burst="100" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083590 2561 flags.go:64] FLAG: --event-qps="50" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083594 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083599 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083604 2561 flags.go:64] FLAG: --eviction-hard="" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083611 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083615 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083620 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083625 2561 flags.go:64] FLAG: --eviction-soft="" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083630 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083635 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 14:55:19.090401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083640 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083644 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083648 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083656 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083661 2561 flags.go:64] FLAG: --feature-gates="" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083667 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083672 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083677 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083684 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083689 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083694 2561 flags.go:64] FLAG: --help="false" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083699 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083704 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083709 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083714 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083719 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083725 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083729 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083733 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083738 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083743 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083748 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083753 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083758 2561 flags.go:64] FLAG: --kube-reserved="" Jul 28 14:55:19.091079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083763 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083767 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083772 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083777 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083782 2561 flags.go:64] FLAG: --lock-file="" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083786 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083791 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083796 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083804 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083809 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083814 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083820 2561 flags.go:64] FLAG: --logging-format="text" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083825 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083831 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083835 2561 flags.go:64] FLAG: --manifest-url="" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083840 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083847 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083852 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083859 2561 flags.go:64] FLAG: --max-pods="110" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083864 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083869 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083874 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083878 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083883 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083888 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 14:55:19.091701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083893 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083903 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083908 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083912 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083917 2561 flags.go:64] FLAG: --pod-cidr="" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083922 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083931 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083936 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083941 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083945 2561 flags.go:64] FLAG: --port="10250" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083950 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083955 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c834ec80a4b1a0be" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083960 2561 flags.go:64] FLAG: --qos-reserved="" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083965 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083971 2561 flags.go:64] FLAG: --register-node="true" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083975 2561 flags.go:64] FLAG: --register-with-taints="" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083987 2561 flags.go:64] FLAG: --registry-burst="10" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083992 2561 flags.go:64] FLAG: --registry-qps="5" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.083998 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084003 2561 flags.go:64] FLAG: --reserved-memory="" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084009 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084014 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084019 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084024 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084029 2561 flags.go:64] FLAG: --runonce="false" Jul 28 14:55:19.092333 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084034 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084039 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084044 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084048 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084053 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084059 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084064 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084068 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084074 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084078 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084090 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084095 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084100 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084105 2561 flags.go:64] FLAG: --system-cgroups="" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084110 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084119 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084124 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084129 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084135 2561 flags.go:64] FLAG: --tls-min-version="" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084141 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084146 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084151 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084155 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084160 2561 flags.go:64] FLAG: --v="2" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084166 2561 flags.go:64] FLAG: --version="false" Jul 28 14:55:19.092946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084175 2561 flags.go:64] FLAG: --vmodule="" Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084180 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.084186 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084364 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084372 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084376 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084381 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084385 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084390 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084394 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084398 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084403 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084407 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084411 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084415 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084419 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084423 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084427 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084431 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084436 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 14:55:19.093605 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084440 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084460 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084465 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084469 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084473 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084478 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084482 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084490 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084495 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084499 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084503 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084508 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084513 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084517 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084522 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084526 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084530 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084533 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084538 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084543 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 14:55:19.094126 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084547 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084552 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084556 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084560 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084564 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084569 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084573 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084577 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084582 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084586 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084590 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084595 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084600 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084604 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084610 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084616 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084621 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084628 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 14:55:19.095282 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084634 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084639 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084645 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084649 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084654 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084657 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084663 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084667 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084673 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084708 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084714 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084718 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084721 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084726 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084729 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084732 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084736 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084739 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084741 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084744 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 14:55:19.095767 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084747 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084749 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084752 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084755 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084757 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084761 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084763 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084766 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084769 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084772 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084774 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084777 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084780 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084783 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084786 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084788 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084791 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084796 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084801 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084803 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 14:55:19.096283 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084806 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084810 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084814 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.084817 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.086212 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.093508 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.093521 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.093538 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.093547 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093602 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093607 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093611 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093615 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093618 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093620 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 14:55:19.096889 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093624 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093627 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093630 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093633 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093637 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093641 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093644 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093647 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093650 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093653 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093656 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093659 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093661 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093664 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093667 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093669 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093673 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093675 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093678 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 14:55:19.097291 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093680 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093683 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093685 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093688 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093691 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093694 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093697 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093700 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093703 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093705 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093708 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093711 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093713 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093716 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093719 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093721 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093724 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093726 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093729 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093732 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 14:55:19.097775 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093734 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093737 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093739 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093741 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093744 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093747 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093750 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093752 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093754 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093757 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093763 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093766 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093769 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093771 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093774 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093776 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093779 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093782 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093785 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093787 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 14:55:19.098258 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093790 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093792 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093795 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093797 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093800 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093803 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093805 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093808 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093810 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093814 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093817 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093820 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093823 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093826 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093829 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093831 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093834 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093837 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093839 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 14:55:19.098773 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093841 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093844 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093847 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093849 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093852 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093855 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093858 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093860 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093863 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093867 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093871 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093874 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093877 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093880 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.093883 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 14:55:19.099232 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.093888 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094008 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094013 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094016 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094020 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094023 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094027 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094030 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094032 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094035 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094037 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094040 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094042 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094045 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094047 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094050 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094053 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094055 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094058 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 14:55:19.099676 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094060 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094063 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094065 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094069 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094072 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094074 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094076 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094079 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094082 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094085 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094087 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094090 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094092 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094095 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094097 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094100 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094102 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094105 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094108 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094110 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 14:55:19.100155 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094113 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094115 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094118 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094120 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094123 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094126 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094128 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094131 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094133 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094136 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094139 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094142 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094144 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094147 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094150 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094152 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094156 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094158 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094161 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094163 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 14:55:19.100708 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094166 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094168 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094171 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094173 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094176 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094178 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094181 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094183 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094186 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094188 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094191 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094193 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094196 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094198 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094201 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094203 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094206 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094209 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094211 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094214 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 14:55:19.101173 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094216 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094219 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094223 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094227 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094230 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094233 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094236 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094238 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094241 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094244 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094247 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094249 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094252 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094254 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094257 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094259 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094262 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094265 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094267 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 14:55:19.101719 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094269 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 14:55:19.102227 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:19.094272 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 14:55:19.102227 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.094276 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 14:55:19.102227 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.094391 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 14:55:19.102227 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.096757 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 14:55:19.102227 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.098480 2561 server.go:1019] "Starting client certificate rotation" Jul 28 14:55:19.102227 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.098578 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 14:55:19.102227 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.098633 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 14:55:19.102227 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.101293 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 14:55:19.105437 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.105418 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 14:55:19.122863 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.122839 2561 log.go:25] "Validated CRI v1 runtime API" Jul 28 14:55:19.125467 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.125437 2561 log.go:25] "Validated CRI v1 image API" Jul 28 14:55:19.126369 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.126347 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 14:55:19.129642 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.129627 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 14:55:19.132432 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.132414 2561 fs.go:135] Filesystem UUIDs: map[46cf700d-3a56-40ac-b344-442fc8227437:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8ffde126-1c88-49df-b25b-80e532847818:/dev/nvme0n1p3] Jul 28 14:55:19.132497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.132433 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 14:55:19.138283 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.138170 2561 manager.go:216] Machine: {Timestamp:2026-07-28 14:55:19.136761721 +0000 UTC m=+0.380700759 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099471 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21dafd6e638f16fc44f0f6f833644c SystemUUID:ec21dafd-6e63-8f16-fc44-f0f6f833644c BootID:db93efaf-0969-4039-a99d-7ce29ce01275 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:e9:e3:a4:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:e9:e3:a4:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:56:27:83:ea:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 14:55:19.138283 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.138282 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 14:55:19.138406 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.138395 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 14:55:19.141859 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.141836 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 14:55:19.141991 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.141862 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-173.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 14:55:19.143303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.143293 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 14:55:19.143343 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.143306 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 14:55:19.143891 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.143882 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 14:55:19.143926 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.143900 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 14:55:19.145721 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.145711 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 14:55:19.150392 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150380 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 28 14:55:19.150526 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150516 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 14:55:19.150572 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150548 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 28 14:55:19.150572 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150557 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 14:55:19.150648 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150577 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 14:55:19.150648 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150587 2561 kubelet.go:398] "Adding apiserver pod source" Jul 28 14:55:19.150648 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150597 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 14:55:19.150972 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150957 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 14:55:19.151024 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.150981 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 14:55:19.153284 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.153263 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 14:55:19.154921 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.154908 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 14:55:19.154979 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.154938 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 14:55:19.155666 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155655 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 14:55:19.155706 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155671 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 14:55:19.155706 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155678 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 14:55:19.155706 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155685 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 14:55:19.155706 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155694 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 14:55:19.155706 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155699 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 14:55:19.155846 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155741 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 14:55:19.155846 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155747 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 14:55:19.155846 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155754 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 14:55:19.155846 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155761 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 14:55:19.155846 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155777 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 14:55:19.155846 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.155785 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 14:55:19.156699 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.156684 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 14:55:19.156699 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.156697 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 14:55:19.160130 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.160113 2561 server.go:1268] "Started kubelet" Jul 28 14:55:19.160310 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.160206 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 14:55:19.160310 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.160279 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 14:55:19.160411 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.160374 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 14:55:19.161003 ip-10-0-129-173 systemd[1]: Started Kubernetes Kubelet. Jul 28 14:55:19.162086 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.162067 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-173.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 14:55:19.162429 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.162408 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 14:55:19.162889 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.162868 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 14:55:19.163014 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.162988 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 14:55:19.163680 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.163650 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 28 14:55:19.166200 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.166172 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 14:55:19.169534 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.168387 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-173.ec2.internal.18c67be3759e4284 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-173.ec2.internal,UID:ip-10-0-129-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-173.ec2.internal,},FirstTimestamp:2026-07-28 14:55:19.16007898 +0000 UTC m=+0.404018016,LastTimestamp:2026-07-28 14:55:19.16007898 +0000 UTC m=+0.404018016,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-173.ec2.internal,}" Jul 28 14:55:19.173872 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.173855 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 14:55:19.173872 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.173870 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 14:55:19.173997 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.173958 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.174642 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174620 2561 factory.go:55] Registering systemd factory Jul 28 14:55:19.174736 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174646 2561 factory.go:223] Registration of the systemd container factory successfully Jul 28 14:55:19.174736 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174621 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 14:55:19.174736 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174624 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 14:55:19.174736 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174679 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 14:55:19.174912 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174764 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 28 14:55:19.174912 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174773 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 28 14:55:19.174912 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174866 2561 factory.go:153] Registering CRI-O factory Jul 28 14:55:19.174912 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174880 2561 factory.go:223] Registration of the crio container factory successfully Jul 28 14:55:19.175072 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174933 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 14:55:19.175072 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174956 2561 factory.go:103] Registering Raw factory Jul 28 14:55:19.175072 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.174971 2561 manager.go:1196] Started watching for new ooms in manager Jul 28 14:55:19.175283 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.175267 2561 manager.go:349] Starting recovery of all containers Jul 28 14:55:19.175622 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.175595 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 14:55:19.175689 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.175674 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 14:55:19.178459 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.178419 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-767bg" Jul 28 14:55:19.184477 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.184460 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-767bg" Jul 28 14:55:19.185006 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.184991 2561 manager.go:354] Recovery completed Jul 28 14:55:19.191020 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.191007 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 14:55:19.192605 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.192590 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jul 28 14:55:19.192668 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.192616 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 14:55:19.192668 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.192626 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jul 28 14:55:19.193132 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.193120 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 14:55:19.193132 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.193129 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 14:55:19.193132 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.193132 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 14:55:19.193294 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.193143 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 28 14:55:19.193897 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.193882 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jul 28 14:55:19.193982 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.193907 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 14:55:19.193982 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.193919 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jul 28 14:55:19.195148 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.195131 2561 policy_none.go:49] "None policy: Start" Jul 28 14:55:19.195148 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.195145 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 14:55:19.195278 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.195155 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 14:55:19.274332 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.274190 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.347806 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.347737 2561 policy_none.go:47] "Start" Jul 28 14:55:19.374550 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.374529 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.376000 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.375979 2561 manager.go:337] "Starting Device Plugin manager" Jul 28 14:55:19.376116 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.376020 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 14:55:19.376116 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.376033 2561 server.go:87] "Starting device plugin registration server" Jul 28 14:55:19.376310 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.376296 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 14:55:19.376384 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.376311 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 14:55:19.376430 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.376382 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 14:55:19.376501 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.376487 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 14:55:19.376501 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.376495 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 14:55:19.377004 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.376985 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 14:55:19.377088 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.377035 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.382968 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.382948 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-173.ec2.internal\" not found" node="ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.463944 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.463910 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 14:55:19.466270 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.465102 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 14:55:19.466270 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.465148 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 14:55:19.466270 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.465174 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 14:55:19.466270 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.465216 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 14:55:19.467733 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.467718 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 14:55:19.476873 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.476859 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 14:55:19.477680 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.477664 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jul 28 14:55:19.477765 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.477698 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 14:55:19.477765 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.477713 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jul 28 14:55:19.477765 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.477741 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.489084 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.489068 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.489160 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.489087 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-173.ec2.internal\": node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.516302 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.516278 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.565301 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.565263 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal"] Jul 28 14:55:19.565380 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.565348 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 14:55:19.566941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.566925 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jul 28 14:55:19.567038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.566991 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 14:55:19.567038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.567010 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jul 28 14:55:19.569472 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.569440 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 14:55:19.569559 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.569547 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.569610 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.569573 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 14:55:19.570209 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.570191 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jul 28 14:55:19.570307 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.570225 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 14:55:19.570307 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.570236 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jul 28 14:55:19.570307 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.570191 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jul 28 14:55:19.570307 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.570295 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 14:55:19.570307 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.570308 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jul 28 14:55:19.572510 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.572495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.572589 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.572519 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 14:55:19.573156 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.573143 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientMemory" Jul 28 14:55:19.573214 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.573167 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 14:55:19.573214 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.573181 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeHasSufficientPID" Jul 28 14:55:19.575895 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.575876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c3dfbb83181e3bac48a93565aaf78ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"8c3dfbb83181e3bac48a93565aaf78ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.575970 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.575935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c3dfbb83181e3bac48a93565aaf78ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"8c3dfbb83181e3bac48a93565aaf78ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.575970 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.575964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5521078145c4ebdc55ed01091d72db27-config\") pod \"kube-apiserver-proxy-ip-10-0-129-173.ec2.internal\" (UID: \"5521078145c4ebdc55ed01091d72db27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.585971 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.585950 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-173.ec2.internal\" not found" node="ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.590326 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.590312 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-173.ec2.internal\" not found" node="ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.616592 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.616543 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.676269 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.676239 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c3dfbb83181e3bac48a93565aaf78ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"8c3dfbb83181e3bac48a93565aaf78ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.676409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.676305 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c3dfbb83181e3bac48a93565aaf78ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"8c3dfbb83181e3bac48a93565aaf78ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.676409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.676309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c3dfbb83181e3bac48a93565aaf78ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"8c3dfbb83181e3bac48a93565aaf78ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.676409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.676342 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8c3dfbb83181e3bac48a93565aaf78ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal\" (UID: \"8c3dfbb83181e3bac48a93565aaf78ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.676409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.676348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5521078145c4ebdc55ed01091d72db27-config\") pod \"kube-apiserver-proxy-ip-10-0-129-173.ec2.internal\" (UID: \"5521078145c4ebdc55ed01091d72db27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.676409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.676376 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5521078145c4ebdc55ed01091d72db27-config\") pod \"kube-apiserver-proxy-ip-10-0-129-173.ec2.internal\" (UID: \"5521078145c4ebdc55ed01091d72db27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.716704 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.716679 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.819887 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.819838 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.888412 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.888336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.895366 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.894414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jul 28 14:55:19.920419 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:19.920392 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:19.991842 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:19.991811 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 14:55:20.021127 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:20.021101 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:20.024498 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.024481 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 14:55:20.097545 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.097514 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 14:55:20.098151 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.097651 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 14:55:20.098151 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.097688 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 14:55:20.098151 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.097697 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 14:55:20.121770 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:20.121731 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:20.190771 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.190681 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 14:50:19 +0000 UTC" deadline="2028-01-10 09:07:20.085853239 +0000 UTC" Jul 28 14:55:20.190771 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.190712 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12738h11m59.895144325s" Jul 28 14:55:20.222002 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:20.221969 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:20.322429 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:20.322405 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-173.ec2.internal\" not found" Jul 28 14:55:20.377313 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.377287 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 14:55:20.450504 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:20.450431 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3dfbb83181e3bac48a93565aaf78ee.slice/crio-0eaacf2f270fd58329eb1a269734484efce8b56cd23b90d2fccdbf21955f9e4b WatchSource:0}: Error finding container 0eaacf2f270fd58329eb1a269734484efce8b56cd23b90d2fccdbf21955f9e4b: Status 404 returned error can't find the container with id 0eaacf2f270fd58329eb1a269734484efce8b56cd23b90d2fccdbf21955f9e4b Jul 28 14:55:20.450832 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:20.450818 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5521078145c4ebdc55ed01091d72db27.slice/crio-e7709bd018e5edf64f3cdda951cd33df38430e44a5065956c8789c0d2616c371 WatchSource:0}: Error finding container e7709bd018e5edf64f3cdda951cd33df38430e44a5065956c8789c0d2616c371: Status 404 returned error can't find the container with id e7709bd018e5edf64f3cdda951cd33df38430e44a5065956c8789c0d2616c371 Jul 28 14:55:20.456151 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.456129 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 14:55:20.468943 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.468902 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" event={"ID":"5521078145c4ebdc55ed01091d72db27","Type":"ContainerStarted","Data":"e7709bd018e5edf64f3cdda951cd33df38430e44a5065956c8789c0d2616c371"} Jul 28 14:55:20.470053 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.470029 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" event={"ID":"8c3dfbb83181e3bac48a93565aaf78ee","Type":"ContainerStarted","Data":"0eaacf2f270fd58329eb1a269734484efce8b56cd23b90d2fccdbf21955f9e4b"} Jul 28 14:55:20.474378 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.474357 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" Jul 28 14:55:20.488291 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.488271 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 14:55:20.489234 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.489222 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" Jul 28 14:55:20.498251 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:20.498235 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 14:55:21.152401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.152364 2561 apiserver.go:52] "Watching apiserver" Jul 28 14:55:21.163368 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.162906 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 14:55:21.163559 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.163404 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-xxgvq","openshift-multus/multus-mt7wg","openshift-network-operator/iptables-alerter-q47hb","openshift-ovn-kubernetes/ovnkube-node-t9wdd","kube-system/global-pull-secret-syncer-5twhq","kube-system/konnectivity-agent-xljgs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr","openshift-cluster-node-tuning-operator/tuned-9m5vc","openshift-dns/node-resolver-d99pr","openshift-image-registry/node-ca-82hgb","openshift-multus/network-metrics-daemon-246q4","openshift-network-diagnostics/network-check-target-kfhzq","kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal"] Jul 28 14:55:21.166225 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.166189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.168403 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.168252 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 14:55:21.168403 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.168383 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 14:55:21.168614 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.168490 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qc986\"" Jul 28 14:55:21.168614 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.168541 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.168734 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.168629 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 14:55:21.170654 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.170632 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hntzh\"" Jul 28 14:55:21.170762 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.170683 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 14:55:21.170934 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.170917 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 14:55:21.171022 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.171000 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 14:55:21.171181 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.171161 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 14:55:21.171723 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.171705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.174266 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.174105 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 14:55:21.174266 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.174145 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 14:55:21.174266 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.174155 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 14:55:21.174266 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.174108 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.174547 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.174299 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lg24j\"" Jul 28 14:55:21.174961 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.174584 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 14:55:21.176499 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.176420 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 14:55:21.176623 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.176565 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 14:55:21.176748 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.176731 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hwt57\"" Jul 28 14:55:21.176831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.176742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:21.176831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.176789 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 14:55:21.176945 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.176818 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:21.176945 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.176830 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 14:55:21.177055 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.176999 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 14:55:21.177109 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.177094 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 14:55:21.179334 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.179314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:21.179432 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.179392 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:21.181896 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.181874 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.184072 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184036 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 14:55:21.184171 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184036 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7gjp6\"" Jul 28 14:55:21.184417 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184395 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 14:55:21.184509 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.184846 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:21.184846 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-cni-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-cnibin\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c63b8314-0511-457e-83a0-d65b438a79f1-serviceca\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.185019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.184953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-system-cni-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185203 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovnkube-config\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185203 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a506c49d-8572-4cc0-9efc-844fc28f8f06-cni-binary-copy\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185203 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-cni-bin\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185203 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-conf-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185203 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-systemd\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185203 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-env-overrides\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185203 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185184 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-socket-dir-parent\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-cni-multus\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-hostroot\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-etc-kubernetes\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-slash\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-k8s-cni-cncf-io\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-netns\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-kubelet\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-daemon-config\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-iptables-alerter-script\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185511 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-host-slash\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-var-lib-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-ovn\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovn-node-metrics-cert\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvl67\" (UniqueName: \"kubernetes.io/projected/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-kube-api-access-dvl67\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185714 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c63b8314-0511-457e-83a0-d65b438a79f1-host\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185747 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-cni-bin\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185770 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-cni-netd\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185823 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-multus-certs\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-kubelet\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-os-release\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn6z9\" (UniqueName: \"kubernetes.io/projected/a506c49d-8572-4cc0-9efc-844fc28f8f06-kube-api-access-hn6z9\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-node-log\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.185954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185951 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovnkube-script-lib\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.186700 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.185980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vfx6\" (UniqueName: \"kubernetes.io/projected/a7b92eaf-459b-48d8-9124-a4a81474e0b7-kube-api-access-6vfx6\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.186700 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.186004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds5rg\" (UniqueName: \"kubernetes.io/projected/c63b8314-0511-457e-83a0-d65b438a79f1-kube-api-access-ds5rg\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.186700 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.186019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-systemd-units\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.186700 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.186072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-run-netns\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.186700 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.186102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-etc-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.186700 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.186123 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-log-socket\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.187000 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.186838 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 14:55:21.187000 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.186847 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 14:55:21.187101 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.187068 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-twmb5\"" Jul 28 14:55:21.187182 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.187144 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 14:55:21.187476 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.187451 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.187595 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.187568 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:21.190420 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.190068 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:21.192403 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.192375 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 14:55:21.192525 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.192415 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wb78t\"" Jul 28 14:55:21.193546 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.192853 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 14:55:21.193546 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.193181 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.195835 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.195810 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 14:55:21.195931 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.195876 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 14:55:21.195931 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.195881 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8fnzc\"" Jul 28 14:55:21.197539 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.196403 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 14:55:21.197539 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.196624 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.198779 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.198756 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 14:55:21.198779 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.198775 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 14:55:21.198927 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.198861 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hjxkc\"" Jul 28 14:55:21.209468 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.209449 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qkpjx" Jul 28 14:55:21.217362 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.217340 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qkpjx" Jul 28 14:55:21.275814 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.275765 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 14:55:21.286644 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-daemon-config\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.286802 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d3df34e-f920-4f2a-a4fc-473d8b05e772-konnectivity-ca\") pod \"konnectivity-agent-xljgs\" (UID: \"8d3df34e-f920-4f2a-a4fc-473d8b05e772\") " pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:21.286802 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-registration-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.286802 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-lib-modules\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.286802 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovn-node-metrics-cert\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.286802 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvl67\" (UniqueName: \"kubernetes.io/projected/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-kube-api-access-dvl67\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.286802 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xs4z\" (UniqueName: \"kubernetes.io/projected/8db45231-7e81-4ae8-bd6d-6156af2f68da-kube-api-access-4xs4z\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d3df34e-f920-4f2a-a4fc-473d8b05e772-agent-certs\") pod \"konnectivity-agent-xljgs\" (UID: \"8d3df34e-f920-4f2a-a4fc-473d8b05e772\") " pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-kubelet-config\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-device-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286899 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-tuned\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286922 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c63b8314-0511-457e-83a0-d65b438a79f1-host\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-cni-bin\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286972 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-cni-netd\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.286996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-multus-certs\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-kubelet\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-os-release\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287095 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn6z9\" (UniqueName: \"kubernetes.io/projected/a506c49d-8572-4cc0-9efc-844fc28f8f06-kube-api-access-hn6z9\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-modprobe-d\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287174 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysctl-d\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-tmp\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-node-log\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vfx6\" (UniqueName: \"kubernetes.io/projected/a7b92eaf-459b-48d8-9124-a4a81474e0b7-kube-api-access-6vfx6\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysctl-conf\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287297 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-systemd-units\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-systemd-units\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-etc-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.287582 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-cnibin\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a506c49d-8572-4cc0-9efc-844fc28f8f06-cni-binary-copy\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287619 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-conf-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-etc-kubernetes\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-system-cni-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287722 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-os-release\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287743 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287774 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-run\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287877 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-node-log\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287894 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-cni-bin\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287934 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-cni-netd\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-sys\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.287984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-systemd\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-env-overrides\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-socket-dir-parent\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.288242 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288065 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c63b8314-0511-457e-83a0-d65b438a79f1-host\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-dbus\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-socket-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288117 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wkf6\" (UniqueName: \"kubernetes.io/projected/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-kube-api-access-2wkf6\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-slash\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-k8s-cni-cncf-io\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288160 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-multus-certs\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-netns\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-kubelet\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288252 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-host-slash\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288258 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-etc-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-os-release\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-var-lib-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288312 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-cnibin\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.289098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-system-cni-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288414 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-netns\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288464 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-kubelet\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288512 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-kubelet\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288537 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-daemon-config\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-host-slash\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288638 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-var-lib-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288624 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-socket-dir-parent\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-ovn\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288697 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2j59\" (UniqueName: \"kubernetes.io/projected/a4296243-f2f2-41db-b931-eb6e89110195-kube-api-access-b2j59\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288767 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-conf-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288783 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-etc-kubernetes\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288822 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-openvswitch\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288842 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a506c49d-8572-4cc0-9efc-844fc28f8f06-cni-binary-copy\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288849 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-system-cni-dir\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288857 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-ovn\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysconfig\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.290117 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288889 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-slash\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-kubernetes\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db45231-7e81-4ae8-bd6d-6156af2f68da-tmp-dir\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288940 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-run-k8s-cni-cncf-io\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.288981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289021 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-run-systemd\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-var-lib-kubelet\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovnkube-script-lib\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289271 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-systemd\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-iptables-alerter-script\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289348 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-env-overrides\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8db45231-7e81-4ae8-bd6d-6156af2f68da-hosts-file\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds5rg\" (UniqueName: \"kubernetes.io/projected/c63b8314-0511-457e-83a0-d65b438a79f1-kube-api-access-ds5rg\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-run-netns\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-log-socket\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-cni-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws9rr\" (UniqueName: \"kubernetes.io/projected/967987f0-7502-49d4-abd8-2c27df878b26-kube-api-access-ws9rr\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289656 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-cnibin\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289662 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovnkube-script-lib\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c63b8314-0511-457e-83a0-d65b438a79f1-serviceca\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovnkube-config\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289718 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-host-run-netns\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-cni-bin\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-sys-fs\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-host\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289894 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-cni-bin\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289899 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-iptables-alerter-script\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-cni-multus\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289925 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a7b92eaf-459b-48d8-9124-a4a81474e0b7-log-socket\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-hostroot\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk5zq\" (UniqueName: \"kubernetes.io/projected/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-kube-api-access-kk5zq\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.291941 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.289860 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-multus-cni-dir\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.292906 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.290129 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-host-var-lib-cni-multus\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.292906 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.290169 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a506c49d-8572-4cc0-9efc-844fc28f8f06-hostroot\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.292906 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.290413 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c63b8314-0511-457e-83a0-d65b438a79f1-serviceca\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.292906 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.290682 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovnkube-config\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.293289 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.293265 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a7b92eaf-459b-48d8-9124-a4a81474e0b7-ovn-node-metrics-cert\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.295280 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.295257 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 14:55:21.295280 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.295282 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 14:55:21.295481 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.295296 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jr9bc for pod openshift-network-diagnostics/network-check-target-kfhzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:21.295481 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.295438 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc podName:22d5e416-87ce-47db-9b63-341066302104 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:21.795410106 +0000 UTC m=+3.039349146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jr9bc" (UniqueName: "kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc") pod "network-check-target-kfhzq" (UID: "22d5e416-87ce-47db-9b63-341066302104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:21.299068 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.298275 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn6z9\" (UniqueName: \"kubernetes.io/projected/a506c49d-8572-4cc0-9efc-844fc28f8f06-kube-api-access-hn6z9\") pod \"multus-mt7wg\" (UID: \"a506c49d-8572-4cc0-9efc-844fc28f8f06\") " pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.299068 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.298611 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvl67\" (UniqueName: \"kubernetes.io/projected/868f8bed-0440-4b1f-a42e-d5e5c65a96f2-kube-api-access-dvl67\") pod \"iptables-alerter-q47hb\" (UID: \"868f8bed-0440-4b1f-a42e-d5e5c65a96f2\") " pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.299068 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.298627 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds5rg\" (UniqueName: \"kubernetes.io/projected/c63b8314-0511-457e-83a0-d65b438a79f1-kube-api-access-ds5rg\") pod \"node-ca-82hgb\" (UID: \"c63b8314-0511-457e-83a0-d65b438a79f1\") " pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.300402 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.300374 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vfx6\" (UniqueName: \"kubernetes.io/projected/a7b92eaf-459b-48d8-9124-a4a81474e0b7-kube-api-access-6vfx6\") pod \"ovnkube-node-t9wdd\" (UID: \"a7b92eaf-459b-48d8-9124-a4a81474e0b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.376832 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.376799 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 14:55:21.390370 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:21.390600 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.390600 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390418 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-run\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.390600 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-sys\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.390600 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.390600 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-dbus\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.390600 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-socket-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.390600 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.390600 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wkf6\" (UniqueName: \"kubernetes.io/projected/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-kube-api-access-2wkf6\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-os-release\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2j59\" (UniqueName: \"kubernetes.io/projected/a4296243-f2f2-41db-b931-eb6e89110195-kube-api-access-b2j59\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-system-cni-dir\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysconfig\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-kubernetes\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db45231-7e81-4ae8-bd6d-6156af2f68da-tmp-dir\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-var-lib-kubelet\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390868 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-systemd\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8db45231-7e81-4ae8-bd6d-6156af2f68da-hosts-file\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws9rr\" (UniqueName: \"kubernetes.io/projected/967987f0-7502-49d4-abd8-2c27df878b26-kube-api-access-ws9rr\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.390993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-cnibin\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.391019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391022 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-sys-fs\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-host\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk5zq\" (UniqueName: \"kubernetes.io/projected/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-kube-api-access-kk5zq\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d3df34e-f920-4f2a-a4fc-473d8b05e772-konnectivity-ca\") pod \"konnectivity-agent-xljgs\" (UID: \"8d3df34e-f920-4f2a-a4fc-473d8b05e772\") " pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-registration-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-lib-modules\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xs4z\" (UniqueName: \"kubernetes.io/projected/8db45231-7e81-4ae8-bd6d-6156af2f68da-kube-api-access-4xs4z\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d3df34e-f920-4f2a-a4fc-473d8b05e772-agent-certs\") pod \"konnectivity-agent-xljgs\" (UID: \"8d3df34e-f920-4f2a-a4fc-473d8b05e772\") " pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-kubelet-config\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-device-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-tuned\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-modprobe-d\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysctl-d\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-tmp\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysctl-conf\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391665 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-systemd\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.391853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391753 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391755 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-lib-modules\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.391805 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8db45231-7e81-4ae8-bd6d-6156af2f68da-hosts-file\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.391865 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.391945 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs podName:a4296243-f2f2-41db-b931-eb6e89110195 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:21.891908905 +0000 UTC m=+3.135847943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs") pod "network-metrics-daemon-246q4" (UID: "a4296243-f2f2-41db-b931-eb6e89110195") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392059 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-cnibin\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392124 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-sys-fs\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.392140 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392175 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-host\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.392186 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret podName:dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:21.892170596 +0000 UTC m=+3.136109635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret") pod "global-pull-secret-syncer-5twhq" (UID: "dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165") : object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:21.392775 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392237 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-sys\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392850 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392883 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392926 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d3df34e-f920-4f2a-a4fc-473d8b05e772-konnectivity-ca\") pod \"konnectivity-agent-xljgs\" (UID: \"8d3df34e-f920-4f2a-a4fc-473d8b05e772\") " pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392965 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-kubelet-config\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.392994 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-registration-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393007 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-dbus\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393029 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-device-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393042 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-run\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393106 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-socket-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393150 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysctl-d\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393191 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.393303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393258 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-modprobe-d\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.394035 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393463 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.394035 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393564 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8db45231-7e81-4ae8-bd6d-6156af2f68da-tmp-dir\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.394035 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393655 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-os-release\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.394035 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393901 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/967987f0-7502-49d4-abd8-2c27df878b26-system-cni-dir\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.394035 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393941 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/967987f0-7502-49d4-abd8-2c27df878b26-cni-binary-copy\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.394035 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.393962 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysconfig\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.394035 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.394011 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-var-lib-kubelet\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.394035 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.394021 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-kubernetes\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.394467 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.394268 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-sysctl-conf\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.396822 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.396792 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-etc-tuned\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.396952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.396809 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-tmp\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.397814 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.397790 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d3df34e-f920-4f2a-a4fc-473d8b05e772-agent-certs\") pod \"konnectivity-agent-xljgs\" (UID: \"8d3df34e-f920-4f2a-a4fc-473d8b05e772\") " pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:21.404075 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.404015 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk5zq\" (UniqueName: \"kubernetes.io/projected/78df0d9e-d6f1-4bd4-85db-194eb3ff1509-kube-api-access-kk5zq\") pod \"tuned-9m5vc\" (UID: \"78df0d9e-d6f1-4bd4-85db-194eb3ff1509\") " pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.404849 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.404823 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xs4z\" (UniqueName: \"kubernetes.io/projected/8db45231-7e81-4ae8-bd6d-6156af2f68da-kube-api-access-4xs4z\") pod \"node-resolver-d99pr\" (UID: \"8db45231-7e81-4ae8-bd6d-6156af2f68da\") " pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.404943 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.404864 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2j59\" (UniqueName: \"kubernetes.io/projected/a4296243-f2f2-41db-b931-eb6e89110195-kube-api-access-b2j59\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:21.407549 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.407509 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws9rr\" (UniqueName: \"kubernetes.io/projected/967987f0-7502-49d4-abd8-2c27df878b26-kube-api-access-ws9rr\") pod \"multus-additional-cni-plugins-xxgvq\" (UID: \"967987f0-7502-49d4-abd8-2c27df878b26\") " pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.409776 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.409748 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wkf6\" (UniqueName: \"kubernetes.io/projected/d74c6fe6-843d-45df-9f14-4bd1b27ffb01-kube-api-access-2wkf6\") pod \"aws-ebs-csi-driver-node-s6tsr\" (UID: \"d74c6fe6-843d-45df-9f14-4bd1b27ffb01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.478748 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.478718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-82hgb" Jul 28 14:55:21.487039 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.487006 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mt7wg" Jul 28 14:55:21.498256 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.498229 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q47hb" Jul 28 14:55:21.503791 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.503618 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:21.510795 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.510773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d99pr" Jul 28 14:55:21.518667 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.518643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" Jul 28 14:55:21.525723 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.525700 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:21.532565 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.532544 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" Jul 28 14:55:21.539598 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.539424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" Jul 28 14:55:21.895214 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.895107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:21.895214 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.895146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:21.895214 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:21.895178 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:21.895545 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.895271 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:21.895545 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.895341 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs podName:a4296243-f2f2-41db-b931-eb6e89110195 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:22.895325313 +0000 UTC m=+4.139264343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs") pod "network-metrics-daemon-246q4" (UID: "a4296243-f2f2-41db-b931-eb6e89110195") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:21.895545 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.895272 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:21.895545 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.895409 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret podName:dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:22.895394378 +0000 UTC m=+4.139333403 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret") pod "global-pull-secret-syncer-5twhq" (UID: "dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165") : object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:21.895545 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.895280 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 14:55:21.895545 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.895431 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 14:55:21.895545 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.895440 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jr9bc for pod openshift-network-diagnostics/network-check-target-kfhzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:21.895545 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:21.895482 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc podName:22d5e416-87ce-47db-9b63-341066302104 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:22.89547398 +0000 UTC m=+4.139413005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr9bc" (UniqueName: "kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc") pod "network-check-target-kfhzq" (UID: "22d5e416-87ce-47db-9b63-341066302104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:22.221112 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:22.221066 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 14:50:21 +0000 UTC" deadline="2028-01-05 04:04:09.529580499 +0000 UTC" Jul 28 14:55:22.221112 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:22.221109 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12613h8m47.308477308s" Jul 28 14:55:22.459555 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:22.459515 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 14:55:22.465651 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:22.465624 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:22.465816 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.465747 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:22.465816 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:22.465803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:22.465956 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.465934 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:22.595289 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.595238 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db45231_7e81_4ae8_bd6d_6156af2f68da.slice/crio-075bcb76189f08a5fcc7622f42448814da0592e8ac5f5ea3cc86613a17b2f7bf WatchSource:0}: Error finding container 075bcb76189f08a5fcc7622f42448814da0592e8ac5f5ea3cc86613a17b2f7bf: Status 404 returned error can't find the container with id 075bcb76189f08a5fcc7622f42448814da0592e8ac5f5ea3cc86613a17b2f7bf Jul 28 14:55:22.620453 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.620422 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78df0d9e_d6f1_4bd4_85db_194eb3ff1509.slice/crio-1ad4a023c29a356bb1e683d7f0a371f9e18ab1fbda130995d3a473dbc68f3e1a WatchSource:0}: Error finding container 1ad4a023c29a356bb1e683d7f0a371f9e18ab1fbda130995d3a473dbc68f3e1a: Status 404 returned error can't find the container with id 1ad4a023c29a356bb1e683d7f0a371f9e18ab1fbda130995d3a473dbc68f3e1a Jul 28 14:55:22.621324 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.621227 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74c6fe6_843d_45df_9f14_4bd1b27ffb01.slice/crio-fe3a4a04a629f21be8a026b5abd8f8024e13bf534edb23e386b0d6a370b48185 WatchSource:0}: Error finding container fe3a4a04a629f21be8a026b5abd8f8024e13bf534edb23e386b0d6a370b48185: Status 404 returned error can't find the container with id fe3a4a04a629f21be8a026b5abd8f8024e13bf534edb23e386b0d6a370b48185 Jul 28 14:55:22.621979 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.621922 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868f8bed_0440_4b1f_a42e_d5e5c65a96f2.slice/crio-c172cd33cf1d08c71baf59d95f881101e1bc68ff2116670f2fb2b80116d95962 WatchSource:0}: Error finding container c172cd33cf1d08c71baf59d95f881101e1bc68ff2116670f2fb2b80116d95962: Status 404 returned error can't find the container with id c172cd33cf1d08c71baf59d95f881101e1bc68ff2116670f2fb2b80116d95962 Jul 28 14:55:22.623494 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.623457 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3df34e_f920_4f2a_a4fc_473d8b05e772.slice/crio-1bf0dd53e2ede2cb250b90c3fc3b564ec0419d4d332de89e644c488c1c28cf57 WatchSource:0}: Error finding container 1bf0dd53e2ede2cb250b90c3fc3b564ec0419d4d332de89e644c488c1c28cf57: Status 404 returned error can't find the container with id 1bf0dd53e2ede2cb250b90c3fc3b564ec0419d4d332de89e644c488c1c28cf57 Jul 28 14:55:22.624395 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.624368 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63b8314_0511_457e_83a0_d65b438a79f1.slice/crio-130990590c6688f1ed0c5a6875e1b5ea5894225e77f9feec2a8a55e068a62a11 WatchSource:0}: Error finding container 130990590c6688f1ed0c5a6875e1b5ea5894225e77f9feec2a8a55e068a62a11: Status 404 returned error can't find the container with id 130990590c6688f1ed0c5a6875e1b5ea5894225e77f9feec2a8a55e068a62a11 Jul 28 14:55:22.625961 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.625520 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda506c49d_8572_4cc0_9efc_844fc28f8f06.slice/crio-7bdd679f0b941226737ab502ce8ad96c5d8f6ff40b1bfadfb6c15b0bd5292262 WatchSource:0}: Error finding container 7bdd679f0b941226737ab502ce8ad96c5d8f6ff40b1bfadfb6c15b0bd5292262: Status 404 returned error can't find the container with id 7bdd679f0b941226737ab502ce8ad96c5d8f6ff40b1bfadfb6c15b0bd5292262 Jul 28 14:55:22.626863 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.626688 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b92eaf_459b_48d8_9124_a4a81474e0b7.slice/crio-0fafb6c2aec960dc0d6679bfe7478aace4689b3fa6d582bef0cafe5fe38a1280 WatchSource:0}: Error finding container 0fafb6c2aec960dc0d6679bfe7478aace4689b3fa6d582bef0cafe5fe38a1280: Status 404 returned error can't find the container with id 0fafb6c2aec960dc0d6679bfe7478aace4689b3fa6d582bef0cafe5fe38a1280 Jul 28 14:55:22.627902 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:22.627876 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967987f0_7502_49d4_abd8_2c27df878b26.slice/crio-1ab49ad52926b17fae492b075b95bb18dc89f5bf6a5dcab6117eb8dee2d3285b WatchSource:0}: Error finding container 1ab49ad52926b17fae492b075b95bb18dc89f5bf6a5dcab6117eb8dee2d3285b: Status 404 returned error can't find the container with id 1ab49ad52926b17fae492b075b95bb18dc89f5bf6a5dcab6117eb8dee2d3285b Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:22.903665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:22.903743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:22.903778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.903909 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.903971 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret podName:dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:24.903950102 +0000 UTC m=+6.147889142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret") pod "global-pull-secret-syncer-5twhq" (UID: "dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165") : object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.904372 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.904394 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.904406 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jr9bc for pod openshift-network-diagnostics/network-check-target-kfhzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.904454 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc podName:22d5e416-87ce-47db-9b63-341066302104 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:24.904438359 +0000 UTC m=+6.148377384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr9bc" (UniqueName: "kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc") pod "network-check-target-kfhzq" (UID: "22d5e416-87ce-47db-9b63-341066302104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.904537 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:22.904601 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:22.904582 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs podName:a4296243-f2f2-41db-b931-eb6e89110195 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:24.9045699 +0000 UTC m=+6.148508926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs") pod "network-metrics-daemon-246q4" (UID: "a4296243-f2f2-41db-b931-eb6e89110195") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:23.095747 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.095474 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 14:55:23.221776 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.221695 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 14:50:21 +0000 UTC" deadline="2028-03-15 11:01:07.771482716 +0000 UTC" Jul 28 14:55:23.221776 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.221734 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14300h5m44.549753598s" Jul 28 14:55:23.466069 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.466035 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:23.466272 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:23.466220 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:23.493064 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.493026 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" event={"ID":"5521078145c4ebdc55ed01091d72db27","Type":"ContainerStarted","Data":"503c6621175b220af6b5388ba1736666a256bd81ceaa4159b01297413d713f8d"} Jul 28 14:55:23.515925 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.515863 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-173.ec2.internal" podStartSLOduration=3.5158425920000003 podStartE2EDuration="3.515842592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:23.51540041 +0000 UTC m=+4.759339456" watchObservedRunningTime="2026-07-28 14:55:23.515842592 +0000 UTC m=+4.759781639" Jul 28 14:55:23.525564 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.525533 2561 generic.go:356] "Generic (PLEG): container finished" podID="8c3dfbb83181e3bac48a93565aaf78ee" containerID="c636a37d0db44047e77b42c46bfb59e57f4ec8caee3ebbf5b9fbdb618e90c383" exitCode=0 Jul 28 14:55:23.526189 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.526159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" event={"ID":"8c3dfbb83181e3bac48a93565aaf78ee","Type":"ContainerDied","Data":"c636a37d0db44047e77b42c46bfb59e57f4ec8caee3ebbf5b9fbdb618e90c383"} Jul 28 14:55:23.535368 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.535340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xljgs" event={"ID":"8d3df34e-f920-4f2a-a4fc-473d8b05e772","Type":"ContainerStarted","Data":"1bf0dd53e2ede2cb250b90c3fc3b564ec0419d4d332de89e644c488c1c28cf57"} Jul 28 14:55:23.548008 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.547967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" event={"ID":"78df0d9e-d6f1-4bd4-85db-194eb3ff1509","Type":"ContainerStarted","Data":"1ad4a023c29a356bb1e683d7f0a371f9e18ab1fbda130995d3a473dbc68f3e1a"} Jul 28 14:55:23.553275 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.553215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d99pr" event={"ID":"8db45231-7e81-4ae8-bd6d-6156af2f68da","Type":"ContainerStarted","Data":"075bcb76189f08a5fcc7622f42448814da0592e8ac5f5ea3cc86613a17b2f7bf"} Jul 28 14:55:23.561791 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.561711 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" event={"ID":"967987f0-7502-49d4-abd8-2c27df878b26","Type":"ContainerStarted","Data":"1ab49ad52926b17fae492b075b95bb18dc89f5bf6a5dcab6117eb8dee2d3285b"} Jul 28 14:55:23.563917 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.563803 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"0fafb6c2aec960dc0d6679bfe7478aace4689b3fa6d582bef0cafe5fe38a1280"} Jul 28 14:55:23.580968 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.580927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mt7wg" event={"ID":"a506c49d-8572-4cc0-9efc-844fc28f8f06","Type":"ContainerStarted","Data":"7bdd679f0b941226737ab502ce8ad96c5d8f6ff40b1bfadfb6c15b0bd5292262"} Jul 28 14:55:23.586468 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.585184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-82hgb" event={"ID":"c63b8314-0511-457e-83a0-d65b438a79f1","Type":"ContainerStarted","Data":"130990590c6688f1ed0c5a6875e1b5ea5894225e77f9feec2a8a55e068a62a11"} Jul 28 14:55:23.603613 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.603584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q47hb" event={"ID":"868f8bed-0440-4b1f-a42e-d5e5c65a96f2","Type":"ContainerStarted","Data":"c172cd33cf1d08c71baf59d95f881101e1bc68ff2116670f2fb2b80116d95962"} Jul 28 14:55:23.616597 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:23.616531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" event={"ID":"d74c6fe6-843d-45df-9f14-4bd1b27ffb01","Type":"ContainerStarted","Data":"fe3a4a04a629f21be8a026b5abd8f8024e13bf534edb23e386b0d6a370b48185"} Jul 28 14:55:24.466438 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:24.466406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:24.466929 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.466566 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:24.467004 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:24.466960 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:24.467079 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.467053 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:24.649889 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:24.649514 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" event={"ID":"8c3dfbb83181e3bac48a93565aaf78ee","Type":"ContainerStarted","Data":"d7f8cb30c5819cded6d26c641496aae52b8d21869a38f6f1d90f5589496bae56"} Jul 28 14:55:24.926050 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:24.926016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:24.926235 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:24.926061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:24.926235 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:24.926102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:24.926235 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.926227 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 14:55:24.926388 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.926250 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 14:55:24.926388 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.926262 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jr9bc for pod openshift-network-diagnostics/network-check-target-kfhzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:24.926388 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.926318 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc podName:22d5e416-87ce-47db-9b63-341066302104 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:28.926300216 +0000 UTC m=+10.170239241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr9bc" (UniqueName: "kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc") pod "network-check-target-kfhzq" (UID: "22d5e416-87ce-47db-9b63-341066302104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:24.926765 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.926746 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:24.926877 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.926800 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs podName:a4296243-f2f2-41db-b931-eb6e89110195 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:28.926785218 +0000 UTC m=+10.170724256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs") pod "network-metrics-daemon-246q4" (UID: "a4296243-f2f2-41db-b931-eb6e89110195") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:24.926877 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.926855 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:24.927001 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:24.926888 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret podName:dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:28.92687754 +0000 UTC m=+10.170816565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret") pod "global-pull-secret-syncer-5twhq" (UID: "dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165") : object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:25.467452 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:25.467406 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:25.467912 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:25.467562 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:26.466137 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:26.466104 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:26.466316 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:26.466250 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:26.466684 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:26.466662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:26.466801 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:26.466780 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:27.466401 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:27.466367 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:27.466897 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:27.466507 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:28.466053 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:28.466011 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:28.466251 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:28.466029 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:28.466251 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.466145 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:28.466251 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.466223 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:28.962911 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:28.962861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:28.962940 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:28.962968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.963007 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.963034 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.963048 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jr9bc for pod openshift-network-diagnostics/network-check-target-kfhzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.963082 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.963105 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc podName:22d5e416-87ce-47db-9b63-341066302104 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:36.963085129 +0000 UTC m=+18.207024170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr9bc" (UniqueName: "kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc") pod "network-check-target-kfhzq" (UID: "22d5e416-87ce-47db-9b63-341066302104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.963130 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret podName:dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:36.96311586 +0000 UTC m=+18.207054890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret") pod "global-pull-secret-syncer-5twhq" (UID: "dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165") : object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.963182 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:28.963383 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:28.963214 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs podName:a4296243-f2f2-41db-b931-eb6e89110195 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:36.96320332 +0000 UTC m=+18.207142342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs") pod "network-metrics-daemon-246q4" (UID: "a4296243-f2f2-41db-b931-eb6e89110195") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:29.467463 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:29.467308 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:29.467463 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:29.467456 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:30.466234 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:30.466200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:30.466705 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:30.466346 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:30.466705 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:30.466513 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:30.466705 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:30.466638 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:31.466139 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:31.466102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:31.466303 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:31.466254 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:32.466008 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:32.465964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:32.466008 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:32.466008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:32.466201 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:32.466100 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:32.466244 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:32.466216 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:33.465859 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:33.465825 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:33.466330 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:33.465954 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:34.465464 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:34.465417 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:34.465635 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:34.465473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:34.465635 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:34.465566 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:34.465746 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:34.465706 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:35.466409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:35.466370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:35.466918 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:35.466507 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:36.466018 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:36.465975 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:36.466209 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:36.465980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:36.466209 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:36.466114 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:36.466321 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:36.466204 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:37.022234 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:37.022200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:37.022248 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:37.022265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.022350 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.022357 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.022382 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.022392 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jr9bc for pod openshift-network-diagnostics/network-check-target-kfhzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.022400 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret podName:dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:53.022387403 +0000 UTC m=+34.266326425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret") pod "global-pull-secret-syncer-5twhq" (UID: "dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165") : object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.022434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc podName:22d5e416-87ce-47db-9b63-341066302104 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:53.022423027 +0000 UTC m=+34.266362062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr9bc" (UniqueName: "kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc") pod "network-check-target-kfhzq" (UID: "22d5e416-87ce-47db-9b63-341066302104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.022351 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:37.022604 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.022499 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs podName:a4296243-f2f2-41db-b931-eb6e89110195 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:53.022487245 +0000 UTC m=+34.266426267 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs") pod "network-metrics-daemon-246q4" (UID: "a4296243-f2f2-41db-b931-eb6e89110195") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:37.466457 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:37.466413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:37.466648 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:37.466557 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:38.465810 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:38.465776 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:38.466259 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:38.465776 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:38.466259 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:38.465919 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:38.466259 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:38.465982 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:39.466360 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:39.466322 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:39.466842 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:39.466413 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:40.465833 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:40.465800 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:40.466028 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:40.465801 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:40.466028 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:40.465927 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:40.466028 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:40.466007 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:41.465953 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.465921 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:41.466580 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:41.466041 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:41.684013 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.683985 2561 generic.go:356] "Generic (PLEG): container finished" podID="967987f0-7502-49d4-abd8-2c27df878b26" containerID="46d1fd83862e2e6804dcc70bd9f517840a376821d5a538e2e8df6e1547014058" exitCode=0 Jul 28 14:55:41.684111 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.684058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" event={"ID":"967987f0-7502-49d4-abd8-2c27df878b26","Type":"ContainerDied","Data":"46d1fd83862e2e6804dcc70bd9f517840a376821d5a538e2e8df6e1547014058"} Jul 28 14:55:41.686340 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.686317 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"18dc2999aa04850a9610cb0d2d86e6d9eb4d86de978e6899015d9fbf2bfd8fa4"} Jul 28 14:55:41.686426 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.686375 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"b33e148bc3a4ba06654931a0ff1d72c95b0dce1784f01c7e945bd72d139a7e1f"} Jul 28 14:55:41.686426 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.686405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"145beb4ad8efeba81fdea99fb956e4f8b91700302f549a6d5f949f69acc22452"} Jul 28 14:55:41.686524 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.686432 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"5bb27719c8f40810fbfd027a1f193d531a72349d7aba7ad81229806601d34cac"} Jul 28 14:55:41.687806 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.687786 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mt7wg" event={"ID":"a506c49d-8572-4cc0-9efc-844fc28f8f06","Type":"ContainerStarted","Data":"071002ab5f35869355db0b60cae5104861cbbe64302c64871f5be26c9b833014"} Jul 28 14:55:41.690559 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.690519 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-82hgb" event={"ID":"c63b8314-0511-457e-83a0-d65b438a79f1","Type":"ContainerStarted","Data":"8e935676920d00c1626ac4771bc55ce868fc0087781e7dc58d4e96adcb4afa0b"} Jul 28 14:55:41.693610 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.693587 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" event={"ID":"d74c6fe6-843d-45df-9f14-4bd1b27ffb01","Type":"ContainerStarted","Data":"72448ec8fd0fee00d11531b01f3128494dcbcfaebd59ff52b2fceff7ee7f04ae"} Jul 28 14:55:41.695041 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.695022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xljgs" event={"ID":"8d3df34e-f920-4f2a-a4fc-473d8b05e772","Type":"ContainerStarted","Data":"65cca0b6d9e75b3f119caeee74bf8cd891e26f8b98dbd8142c114978cf2b5809"} Jul 28 14:55:41.696647 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.696623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" event={"ID":"78df0d9e-d6f1-4bd4-85db-194eb3ff1509","Type":"ContainerStarted","Data":"91ff7848639c1073c10e59f341780bb5f88fb3f107f978e578c4a24bb1f4c080"} Jul 28 14:55:41.698077 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.698055 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d99pr" event={"ID":"8db45231-7e81-4ae8-bd6d-6156af2f68da","Type":"ContainerStarted","Data":"c6df51b46c18d9d52ffa9ff024278718ef1963625b6851ff4dd024302ef07ea7"} Jul 28 14:55:41.707534 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.707499 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-173.ec2.internal" podStartSLOduration=21.707486896 podStartE2EDuration="21.707486896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:24.665054117 +0000 UTC m=+5.908993162" watchObservedRunningTime="2026-07-28 14:55:41.707486896 +0000 UTC m=+22.951425932" Jul 28 14:55:41.720794 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.720756 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d99pr" podStartSLOduration=4.245889444 podStartE2EDuration="22.720744179s" totalImagesPullingTime="18.474854735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:41.72028621 +0000 UTC m=+22.964225255" watchObservedRunningTime="2026-07-28 14:55:41.720744179 +0000 UTC m=+22.964683223" Jul 28 14:55:41.735767 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.735730 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9m5vc" podStartSLOduration=3.267037342 podStartE2EDuration="21.735718136s" totalImagesPullingTime="18.468680794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:41.735305902 +0000 UTC m=+22.979244948" watchObservedRunningTime="2026-07-28 14:55:41.735718136 +0000 UTC m=+22.979657178" Jul 28 14:55:41.747776 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.747740 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-82hgb" podStartSLOduration=4.283121821 podStartE2EDuration="22.747726288s" totalImagesPullingTime="18.464604467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:41.747337037 +0000 UTC m=+22.991276081" watchObservedRunningTime="2026-07-28 14:55:41.747726288 +0000 UTC m=+22.991665332" Jul 28 14:55:41.766552 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.766504 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mt7wg" podStartSLOduration=4.246285571 podStartE2EDuration="22.766489679s" totalImagesPullingTime="18.520204108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:41.765518608 +0000 UTC m=+23.009457653" watchObservedRunningTime="2026-07-28 14:55:41.766489679 +0000 UTC m=+23.010428701" Jul 28 14:55:41.806593 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:41.806554 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xljgs" podStartSLOduration=7.581237015 podStartE2EDuration="21.806531276s" totalImagesPullingTime="14.225294261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:41.80614554 +0000 UTC m=+23.050084579" watchObservedRunningTime="2026-07-28 14:55:41.806531276 +0000 UTC m=+23.050470321" Jul 28 14:55:42.465992 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:42.465964 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:42.466521 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:42.465967 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:42.466521 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:42.466093 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:42.466521 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:42.466182 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:42.704177 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:42.704144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"0fdedb3b08bd110781a2200cf54c49ac926308ddb0c65b4a8c1a7b925567cf0b"} Jul 28 14:55:42.704358 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:42.704237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"af1811693fe3f3cc7e77b41da083eead802b922cd2bd80507f2f88158909f8fe"} Jul 28 14:55:42.706001 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:42.705967 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q47hb" event={"ID":"868f8bed-0440-4b1f-a42e-d5e5c65a96f2","Type":"ContainerStarted","Data":"1f7888bb9b03c8d272b2ee35c316c6181f5edfcd6a201a2e1bf0dc493f12733b"} Jul 28 14:55:42.719825 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:42.719774 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q47hb" podStartSLOduration=5.253740558 podStartE2EDuration="23.719755053s" totalImagesPullingTime="18.466014495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:42.719584841 +0000 UTC m=+23.963523888" watchObservedRunningTime="2026-07-28 14:55:42.719755053 +0000 UTC m=+23.963694098" Jul 28 14:55:42.821765 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:42.821690 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 14:55:43.387287 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:43.387152 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T14:55:42.821714565Z","UUID":"50dd9a88-cfe7-4a8e-bf69-eedd7b94c3ca","Handler":null,"Name":"","Endpoint":""} Jul 28 14:55:43.389270 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:43.389232 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 14:55:43.389270 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:43.389270 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 14:55:43.465679 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:43.465652 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:43.465829 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:43.465776 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:43.709869 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:43.709834 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" event={"ID":"d74c6fe6-843d-45df-9f14-4bd1b27ffb01","Type":"ContainerStarted","Data":"eb2867573ffddb245cce4c57fbb9e62a69d036d098c84f63df58c5a690ac912c"} Jul 28 14:55:44.465920 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.465678 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:44.466093 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.465711 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:44.466093 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:44.466046 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:44.466194 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:44.466125 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:44.594739 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.594701 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:44.595486 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.595463 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:44.716556 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.716474 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"69e6a10eaa788c47ee8607542e6a65ed7cc66e6ce7d3da5846ebae8174709047"} Jul 28 14:55:44.718631 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.718605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" event={"ID":"d74c6fe6-843d-45df-9f14-4bd1b27ffb01","Type":"ContainerStarted","Data":"9cdf08b150423f0f3103491e40eb0c918f68e16a257f0c245e0095f463196234"} Jul 28 14:55:44.718912 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.718889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:44.719389 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.719372 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xljgs" Jul 28 14:55:44.736556 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:44.736518 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6tsr" podStartSLOduration=3.6779864939999998 podStartE2EDuration="24.736504072s" totalImagesPullingTime="21.058517578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:44.736072695 +0000 UTC m=+25.980011753" watchObservedRunningTime="2026-07-28 14:55:44.736504072 +0000 UTC m=+25.980443116" Jul 28 14:55:45.468688 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:45.468663 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:45.468688 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:45.468688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:45.468959 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:45.468778 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:45.468959 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:45.468889 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:46.465883 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:46.465714 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:46.466485 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:46.465985 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:46.723895 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:46.723861 2561 generic.go:356] "Generic (PLEG): container finished" podID="967987f0-7502-49d4-abd8-2c27df878b26" containerID="79cf24b52378ad369e6f2d9551be2792826c2066aa344bab0f348ff2820f76cb" exitCode=0 Jul 28 14:55:46.724094 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:46.723947 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" event={"ID":"967987f0-7502-49d4-abd8-2c27df878b26","Type":"ContainerDied","Data":"79cf24b52378ad369e6f2d9551be2792826c2066aa344bab0f348ff2820f76cb"} Jul 28 14:55:46.727799 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:46.727772 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" event={"ID":"a7b92eaf-459b-48d8-9124-a4a81474e0b7","Type":"ContainerStarted","Data":"6f0450d3d1c4575ddffa77fd43547faa6ca904f56d2a7ccd451668b2fbdaedfa"} Jul 28 14:55:46.728014 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:46.727992 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:46.770431 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:46.770381 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" podStartSLOduration=9.242768537 podStartE2EDuration="27.77036693s" totalImagesPullingTime="18.527598393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:46.76996169 +0000 UTC m=+28.013900746" watchObservedRunningTime="2026-07-28 14:55:46.77036693 +0000 UTC m=+28.014305975" Jul 28 14:55:47.465896 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:47.465864 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:47.466364 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:47.465974 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:47.466364 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:47.466004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:47.466364 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:47.466051 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:47.734261 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:47.731602 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:47.734261 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:47.731740 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:47.747888 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:47.747864 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:47.755692 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:47.755671 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:55:48.466139 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.466112 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:48.466565 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:48.466213 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:48.546991 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.546961 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-246q4"] Jul 28 14:55:48.550524 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.550500 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5twhq"] Jul 28 14:55:48.550641 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.550608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:48.550717 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:48.550685 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:48.551244 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.551222 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kfhzq"] Jul 28 14:55:48.551340 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.551325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:48.551433 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:48.551416 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:48.734786 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.734707 2561 generic.go:356] "Generic (PLEG): container finished" podID="967987f0-7502-49d4-abd8-2c27df878b26" containerID="66e4912ea6bba8139f20c548ef3a3cca5a3233d810b4b96b22672c609bd8ff98" exitCode=0 Jul 28 14:55:48.734933 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.734789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" event={"ID":"967987f0-7502-49d4-abd8-2c27df878b26","Type":"ContainerDied","Data":"66e4912ea6bba8139f20c548ef3a3cca5a3233d810b4b96b22672c609bd8ff98"} Jul 28 14:55:48.734933 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:48.734824 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:48.734933 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:48.734925 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:50.466375 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:50.466189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:50.466738 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:50.466215 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:50.466738 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:50.466479 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:50.466738 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:50.466247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:50.466738 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:50.466548 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:50.466738 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:50.466627 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:50.742148 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:50.742116 2561 generic.go:356] "Generic (PLEG): container finished" podID="967987f0-7502-49d4-abd8-2c27df878b26" containerID="51785773e63de362ef69d7606f98f48d7ee46075c3f55e2b525144a2b82b8f24" exitCode=0 Jul 28 14:55:50.742305 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:50.742175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" event={"ID":"967987f0-7502-49d4-abd8-2c27df878b26","Type":"ContainerDied","Data":"51785773e63de362ef69d7606f98f48d7ee46075c3f55e2b525144a2b82b8f24"} Jul 28 14:55:52.466419 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:52.466381 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:52.467074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:52.466426 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:52.467074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:52.466426 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:52.467074 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:52.466543 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:52.467074 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:52.466635 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:52.467074 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:52.466700 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:53.039860 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:53.039823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:53.040031 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:53.039870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:53.040031 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:53.039914 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:53.040031 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:53.039992 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:53.040031 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:53.040028 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:53.040238 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:53.040034 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 14:55:53.040238 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:53.040051 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 14:55:53.040238 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:53.040063 2561 projected.go:196] Error preparing data for projected volume kube-api-access-jr9bc for pod openshift-network-diagnostics/network-check-target-kfhzq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:53.040238 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:53.040066 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs podName:a4296243-f2f2-41db-b931-eb6e89110195 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:25.040048902 +0000 UTC m=+66.283987935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs") pod "network-metrics-daemon-246q4" (UID: "a4296243-f2f2-41db-b931-eb6e89110195") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 14:55:53.040238 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:53.040087 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret podName:dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:25.040076826 +0000 UTC m=+66.284015853 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret") pod "global-pull-secret-syncer-5twhq" (UID: "dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165") : object "kube-system"/"original-pull-secret" not registered Jul 28 14:55:53.040238 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:53.040102 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc podName:22d5e416-87ce-47db-9b63-341066302104 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:25.04009412 +0000 UTC m=+66.284033143 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jr9bc" (UniqueName: "kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc") pod "network-check-target-kfhzq" (UID: "22d5e416-87ce-47db-9b63-341066302104") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 14:55:54.465608 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:54.465572 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:54.466206 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:54.465622 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:54.466206 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:54.465705 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5twhq" podUID="dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165" Jul 28 14:55:54.466206 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:54.465730 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kfhzq" podUID="22d5e416-87ce-47db-9b63-341066302104" Jul 28 14:55:54.466206 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:54.465773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:54.466206 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:54.465858 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-246q4" podUID="a4296243-f2f2-41db-b931-eb6e89110195" Jul 28 14:55:54.753933 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:54.753904 2561 generic.go:356] "Generic (PLEG): container finished" podID="967987f0-7502-49d4-abd8-2c27df878b26" containerID="e72fb604cc813074abe68e4c2c8672b91efa2e036c0c6cfe60eed43553189aaa" exitCode=0 Jul 28 14:55:54.754029 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:54.753985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" event={"ID":"967987f0-7502-49d4-abd8-2c27df878b26","Type":"ContainerDied","Data":"e72fb604cc813074abe68e4c2c8672b91efa2e036c0c6cfe60eed43553189aaa"} Jul 28 14:55:55.008301 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.008223 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-173.ec2.internal" event="NodeReady" Jul 28 14:55:55.008480 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.008356 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 14:55:55.041907 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.041878 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-df89c7686-jdjq8"] Jul 28 14:55:55.044590 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.044576 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.048721 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.048695 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 14:55:55.048840 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.048764 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 14:55:55.048968 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.048937 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 14:55:55.049308 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.049220 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xps6j\"" Jul 28 14:55:55.052163 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.052117 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 14:55:55.059488 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.059468 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cqjcd"] Jul 28 14:55:55.062384 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.062363 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df89c7686-jdjq8"] Jul 28 14:55:55.062493 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.062479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.062853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.062828 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ftx8w"] Jul 28 14:55:55.064991 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.064973 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 14:55:55.065194 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.065176 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b9z8t\"" Jul 28 14:55:55.065278 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.065241 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 14:55:55.065622 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.065607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ftx8w" Jul 28 14:55:55.067950 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.067934 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 14:55:55.068034 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.067935 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 14:55:55.068272 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.068256 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 14:55:55.068380 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.068366 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cg2l4\"" Jul 28 14:55:55.077083 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.077063 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cqjcd"] Jul 28 14:55:55.077689 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.077669 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ftx8w"] Jul 28 14:55:55.154124 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.154124 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.154280 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154150 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-image-registry-private-configuration\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.154280 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-bound-sa-token\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.154280 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnxsc\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-kube-api-access-pnxsc\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.154280 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcsfp\" (UniqueName: \"kubernetes.io/projected/fe15fa41-8f88-4009-86bf-e3182137eacb-kube-api-access-qcsfp\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.154280 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kgmq\" (UniqueName: \"kubernetes.io/projected/2ef4be95-b8a3-4fdd-9328-6b682672fad2-kube-api-access-7kgmq\") pod \"ingress-canary-ftx8w\" (UID: \"2ef4be95-b8a3-4fdd-9328-6b682672fad2\") " pod="openshift-ingress-canary/ingress-canary-ftx8w" Jul 28 14:55:55.154569 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe15fa41-8f88-4009-86bf-e3182137eacb-config-volume\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.154569 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-trusted-ca\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.154569 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-registry-certificates\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.154569 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef4be95-b8a3-4fdd-9328-6b682672fad2-cert\") pod \"ingress-canary-ftx8w\" (UID: \"2ef4be95-b8a3-4fdd-9328-6b682672fad2\") " pod="openshift-ingress-canary/ingress-canary-ftx8w" Jul 28 14:55:55.154569 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-installation-pull-secrets\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.154569 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe15fa41-8f88-4009-86bf-e3182137eacb-tmp-dir\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.154768 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.154573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec32d959-770c-4665-90ce-da9329d42669-ca-trust-extracted\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.255613 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe15fa41-8f88-4009-86bf-e3182137eacb-tmp-dir\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.255613 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec32d959-770c-4665-90ce-da9329d42669-ca-trust-extracted\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.255777 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255647 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.255777 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.255777 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-image-registry-private-configuration\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.255777 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-bound-sa-token\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.255777 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnxsc\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-kube-api-access-pnxsc\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.255777 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.255739 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 14:55:55.255777 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcsfp\" (UniqueName: \"kubernetes.io/projected/fe15fa41-8f88-4009-86bf-e3182137eacb-kube-api-access-qcsfp\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.255777 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.255778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kgmq\" (UniqueName: \"kubernetes.io/projected/2ef4be95-b8a3-4fdd-9328-6b682672fad2-kube-api-access-7kgmq\") pod \"ingress-canary-ftx8w\" (UID: \"2ef4be95-b8a3-4fdd-9328-6b682672fad2\") " pod="openshift-ingress-canary/ingress-canary-ftx8w" Jul 28 14:55:55.256153 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.255801 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls podName:fe15fa41-8f88-4009-86bf-e3182137eacb nodeName:}" failed. No retries permitted until 2026-07-28 14:55:55.755780876 +0000 UTC m=+36.999719929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls") pod "dns-default-cqjcd" (UID: "fe15fa41-8f88-4009-86bf-e3182137eacb") : secret "dns-default-metrics-tls" not found Jul 28 14:55:55.256153 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.255817 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 14:55:55.256153 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.255834 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df89c7686-jdjq8: secret "image-registry-tls" not found Jul 28 14:55:55.256153 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.255978 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls podName:ec32d959-770c-4665-90ce-da9329d42669 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:55.75596395 +0000 UTC m=+36.999902988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls") pod "image-registry-df89c7686-jdjq8" (UID: "ec32d959-770c-4665-90ce-da9329d42669") : secret "image-registry-tls" not found Jul 28 14:55:55.256153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256044 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe15fa41-8f88-4009-86bf-e3182137eacb-tmp-dir\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.256153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe15fa41-8f88-4009-86bf-e3182137eacb-config-volume\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.256153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256096 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-trusted-ca\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.256153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-registry-certificates\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.256550 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256169 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec32d959-770c-4665-90ce-da9329d42669-ca-trust-extracted\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.256550 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef4be95-b8a3-4fdd-9328-6b682672fad2-cert\") pod \"ingress-canary-ftx8w\" (UID: \"2ef4be95-b8a3-4fdd-9328-6b682672fad2\") " pod="openshift-ingress-canary/ingress-canary-ftx8w" Jul 28 14:55:55.256550 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-installation-pull-secrets\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.256684 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256581 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fe15fa41-8f88-4009-86bf-e3182137eacb-config-volume\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.256684 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.256613 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-registry-certificates\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.257068 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.257043 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-trusted-ca\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.260033 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.259983 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-image-registry-private-configuration\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.260033 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.260006 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ef4be95-b8a3-4fdd-9328-6b682672fad2-cert\") pod \"ingress-canary-ftx8w\" (UID: \"2ef4be95-b8a3-4fdd-9328-6b682672fad2\") " pod="openshift-ingress-canary/ingress-canary-ftx8w" Jul 28 14:55:55.260033 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.260008 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-installation-pull-secrets\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.263946 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.263925 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnxsc\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-kube-api-access-pnxsc\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.264026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.263928 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kgmq\" (UniqueName: \"kubernetes.io/projected/2ef4be95-b8a3-4fdd-9328-6b682672fad2-kube-api-access-7kgmq\") pod \"ingress-canary-ftx8w\" (UID: \"2ef4be95-b8a3-4fdd-9328-6b682672fad2\") " pod="openshift-ingress-canary/ingress-canary-ftx8w" Jul 28 14:55:55.264026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.263965 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-bound-sa-token\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.264696 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.264672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcsfp\" (UniqueName: \"kubernetes.io/projected/fe15fa41-8f88-4009-86bf-e3182137eacb-kube-api-access-qcsfp\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.376411 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.376376 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ftx8w" Jul 28 14:55:55.506836 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.506808 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ftx8w"] Jul 28 14:55:55.511079 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:55:55.511001 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef4be95_b8a3_4fdd_9328_6b682672fad2.slice/crio-5e07f64e7e2edfd8bc7299a212f6d85f87ab39ebb3c4061cf989d0dad5347640 WatchSource:0}: Error finding container 5e07f64e7e2edfd8bc7299a212f6d85f87ab39ebb3c4061cf989d0dad5347640: Status 404 returned error can't find the container with id 5e07f64e7e2edfd8bc7299a212f6d85f87ab39ebb3c4061cf989d0dad5347640 Jul 28 14:55:55.756904 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.756866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ftx8w" event={"ID":"2ef4be95-b8a3-4fdd-9328-6b682672fad2","Type":"ContainerStarted","Data":"5e07f64e7e2edfd8bc7299a212f6d85f87ab39ebb3c4061cf989d0dad5347640"} Jul 28 14:55:55.759381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.759351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:55.759539 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.759384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:55.759539 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.759486 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 14:55:55.759539 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.759488 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 14:55:55.759539 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.759496 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df89c7686-jdjq8: secret "image-registry-tls" not found Jul 28 14:55:55.759539 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.759541 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls podName:ec32d959-770c-4665-90ce-da9329d42669 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:56.759523875 +0000 UTC m=+38.003462899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls") pod "image-registry-df89c7686-jdjq8" (UID: "ec32d959-770c-4665-90ce-da9329d42669") : secret "image-registry-tls" not found Jul 28 14:55:55.759783 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:55.759559 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls podName:fe15fa41-8f88-4009-86bf-e3182137eacb nodeName:}" failed. No retries permitted until 2026-07-28 14:55:56.75954888 +0000 UTC m=+38.003487907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls") pod "dns-default-cqjcd" (UID: "fe15fa41-8f88-4009-86bf-e3182137eacb") : secret "dns-default-metrics-tls" not found Jul 28 14:55:55.759783 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.759645 2561 generic.go:356] "Generic (PLEG): container finished" podID="967987f0-7502-49d4-abd8-2c27df878b26" containerID="63ee640db6b101b897e3ad81e269e1e0e3ed0f3cf3b7af340ef1c32e821d3aa7" exitCode=0 Jul 28 14:55:55.759783 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:55.759690 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" event={"ID":"967987f0-7502-49d4-abd8-2c27df878b26","Type":"ContainerDied","Data":"63ee640db6b101b897e3ad81e269e1e0e3ed0f3cf3b7af340ef1c32e821d3aa7"} Jul 28 14:55:56.465755 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.465719 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:55:56.465923 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.465723 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:55:56.465923 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.465724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:55:56.468249 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.468224 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 14:55:56.468249 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.468238 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 14:55:56.468422 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.468262 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 14:55:56.468685 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.468654 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2w55\"" Jul 28 14:55:56.468796 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.468699 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2klb\"" Jul 28 14:55:56.468796 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.468753 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 14:55:56.766498 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.766463 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" event={"ID":"967987f0-7502-49d4-abd8-2c27df878b26","Type":"ContainerStarted","Data":"5ab22bb0f32fb53a069e6f272ddf36155203076f7f2937ba58a9b0c900421201"} Jul 28 14:55:56.767167 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.767144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:56.767233 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.767177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:56.767303 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:56.767287 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 14:55:56.767369 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:56.767357 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls podName:fe15fa41-8f88-4009-86bf-e3182137eacb nodeName:}" failed. No retries permitted until 2026-07-28 14:55:58.767335861 +0000 UTC m=+40.011274889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls") pod "dns-default-cqjcd" (UID: "fe15fa41-8f88-4009-86bf-e3182137eacb") : secret "dns-default-metrics-tls" not found Jul 28 14:55:56.767458 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:56.767294 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 14:55:56.767458 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:56.767397 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df89c7686-jdjq8: secret "image-registry-tls" not found Jul 28 14:55:56.767458 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:56.767434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls podName:ec32d959-770c-4665-90ce-da9329d42669 nodeName:}" failed. No retries permitted until 2026-07-28 14:55:58.767422588 +0000 UTC m=+40.011361627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls") pod "image-registry-df89c7686-jdjq8" (UID: "ec32d959-770c-4665-90ce-da9329d42669") : secret "image-registry-tls" not found Jul 28 14:55:56.799793 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:56.799600 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xxgvq" podStartSLOduration=9.009718071 podStartE2EDuration="37.799584083s" totalImagesPullingTime="28.789866012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:56.798104961 +0000 UTC m=+38.042044008" watchObservedRunningTime="2026-07-28 14:55:56.799584083 +0000 UTC m=+38.043523128" Jul 28 14:55:58.773518 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:58.773484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ftx8w" event={"ID":"2ef4be95-b8a3-4fdd-9328-6b682672fad2","Type":"ContainerStarted","Data":"d0f45a63e1dacf738bf37d602e6360cc59f261d1518a4fc2f1a83b641bc4b219"} Jul 28 14:55:58.781706 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:58.781684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:55:58.781779 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:58.781715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:55:58.781863 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:58.781820 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 14:55:58.781898 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:58.781875 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls podName:fe15fa41-8f88-4009-86bf-e3182137eacb nodeName:}" failed. No retries permitted until 2026-07-28 14:56:02.781860729 +0000 UTC m=+44.025799755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls") pod "dns-default-cqjcd" (UID: "fe15fa41-8f88-4009-86bf-e3182137eacb") : secret "dns-default-metrics-tls" not found Jul 28 14:55:58.782112 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:58.781824 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 14:55:58.782112 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:58.781915 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df89c7686-jdjq8: secret "image-registry-tls" not found Jul 28 14:55:58.782112 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:55:58.781958 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls podName:ec32d959-770c-4665-90ce-da9329d42669 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:02.781946383 +0000 UTC m=+44.025885412 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls") pod "image-registry-df89c7686-jdjq8" (UID: "ec32d959-770c-4665-90ce-da9329d42669") : secret "image-registry-tls" not found Jul 28 14:55:58.788617 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:55:58.788575 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ftx8w" podStartSLOduration=1.40126925 podStartE2EDuration="3.788559151s" totalImagesPullingTime="2.387289901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:58.788415793 +0000 UTC m=+40.032354839" watchObservedRunningTime="2026-07-28 14:55:58.788559151 +0000 UTC m=+40.032498200" Jul 28 14:56:02.812634 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:02.812599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:56:02.812634 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:02.812634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:56:02.813180 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:02.812764 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 14:56:02.813180 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:02.812792 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 14:56:02.813180 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:02.812803 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df89c7686-jdjq8: secret "image-registry-tls" not found Jul 28 14:56:02.813180 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:02.812856 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls podName:fe15fa41-8f88-4009-86bf-e3182137eacb nodeName:}" failed. No retries permitted until 2026-07-28 14:56:10.812833989 +0000 UTC m=+52.056773017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls") pod "dns-default-cqjcd" (UID: "fe15fa41-8f88-4009-86bf-e3182137eacb") : secret "dns-default-metrics-tls" not found Jul 28 14:56:02.813180 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:02.812876 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls podName:ec32d959-770c-4665-90ce-da9329d42669 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:10.812865977 +0000 UTC m=+52.056805008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls") pod "image-registry-df89c7686-jdjq8" (UID: "ec32d959-770c-4665-90ce-da9329d42669") : secret "image-registry-tls" not found Jul 28 14:56:10.868723 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:10.868683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:56:10.868723 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:10.868724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:56:10.869241 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:10.868834 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 14:56:10.869241 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:10.868885 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 14:56:10.869241 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:10.868906 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df89c7686-jdjq8: secret "image-registry-tls" not found Jul 28 14:56:10.869241 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:10.868897 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls podName:fe15fa41-8f88-4009-86bf-e3182137eacb nodeName:}" failed. No retries permitted until 2026-07-28 14:56:26.868879121 +0000 UTC m=+68.112818151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls") pod "dns-default-cqjcd" (UID: "fe15fa41-8f88-4009-86bf-e3182137eacb") : secret "dns-default-metrics-tls" not found Jul 28 14:56:10.869241 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:10.868953 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls podName:ec32d959-770c-4665-90ce-da9329d42669 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:26.868941016 +0000 UTC m=+68.112880039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls") pod "image-registry-df89c7686-jdjq8" (UID: "ec32d959-770c-4665-90ce-da9329d42669") : secret "image-registry-tls" not found Jul 28 14:56:19.758255 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:19.758223 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t9wdd" Jul 28 14:56:21.504983 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.504952 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn"] Jul 28 14:56:21.509197 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.509034 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.509928 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.509907 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58"] Jul 28 14:56:21.512477 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.512460 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 14:56:21.512576 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.512521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.512640 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.512598 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 14:56:21.514149 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.513288 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 14:56:21.514149 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.513429 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jr9b6\"" Jul 28 14:56:21.514149 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.513619 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 14:56:21.516497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.515990 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 14:56:21.516497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.516118 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dkkgd\"" Jul 28 14:56:21.516497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.516242 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 14:56:21.516497 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.516385 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 14:56:21.517462 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.517428 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 14:56:21.524295 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.524272 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn"] Jul 28 14:56:21.542954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.542922 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58"] Jul 28 14:56:21.544544 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.544523 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15a72792-c48e-4843-a853-888cba7646a3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.544639 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.544550 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzknh\" (UniqueName: \"kubernetes.io/projected/15a72792-c48e-4843-a853-888cba7646a3-kube-api-access-kzknh\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.544639 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.544566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.544639 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.544585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmspq\" (UniqueName: \"kubernetes.io/projected/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-kube-api-access-fmspq\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.544759 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.544673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15a72792-c48e-4843-a853-888cba7646a3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.544759 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.544716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.608576 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.608550 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj"] Jul 28 14:56:21.611377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.611362 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:21.615261 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.615236 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 14:56:21.615419 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.615323 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 14:56:21.615523 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.615496 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 14:56:21.615792 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.615772 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2gtfh\"" Jul 28 14:56:21.616140 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.616119 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-569lv"] Jul 28 14:56:21.618764 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.618746 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f6c796b55-6rppj"] Jul 28 14:56:21.618874 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.618861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.621216 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.621199 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 14:56:21.621322 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.621266 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 14:56:21.621399 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.621385 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 14:56:21.621465 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.621407 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mm98m\"" Jul 28 14:56:21.621465 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.621411 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 14:56:21.621700 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.621669 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.624046 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.624025 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 14:56:21.624372 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.624357 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 14:56:21.624679 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.624660 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 14:56:21.624679 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.624668 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mmnx4\"" Jul 28 14:56:21.624851 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.624696 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 14:56:21.624932 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.624858 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 14:56:21.625012 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.624947 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 14:56:21.627071 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.627051 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 14:56:21.628567 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.628550 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj"] Jul 28 14:56:21.632314 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.632290 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-569lv"] Jul 28 14:56:21.645000 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.644976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd74425-afae-4808-a442-c4ec82f416d9-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.645103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-stats-auth\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.645103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.645103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.645103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:21.645103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd74425-afae-4808-a442-c4ec82f416d9-service-ca-bundle\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.645357 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-default-certificate\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.645357 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645143 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dd74425-afae-4808-a442-c4ec82f416d9-tmp\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.645357 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dd74425-afae-4808-a442-c4ec82f416d9-serving-cert\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.645357 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzknh\" (UniqueName: \"kubernetes.io/projected/15a72792-c48e-4843-a853-888cba7646a3-kube-api-access-kzknh\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.645357 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15a72792-c48e-4843-a853-888cba7646a3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.645357 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9znvq\" (UniqueName: \"kubernetes.io/projected/00e0aa4c-b35f-4423-866c-72612c0498fe-kube-api-access-9znvq\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.645357 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czfh\" (UniqueName: \"kubernetes.io/projected/2dd74425-afae-4808-a442-c4ec82f416d9-kube-api-access-6czfh\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.645738 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmspq\" (UniqueName: \"kubernetes.io/projected/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-kube-api-access-fmspq\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.645738 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2dd74425-afae-4808-a442-c4ec82f416d9-snapshots\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.645738 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.645738 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645506 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15a72792-c48e-4843-a853-888cba7646a3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.645738 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvvtx\" (UniqueName: \"kubernetes.io/projected/db8de329-1652-4e2c-9d1a-07c503825b60-kube-api-access-hvvtx\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:21.645738 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:21.645558 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:21.645738 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.645738 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:21.645612 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls podName:2dbad3ae-1dde-4055-9c15-47fa09b1c18b nodeName:}" failed. No retries permitted until 2026-07-28 14:56:22.145596934 +0000 UTC m=+63.389535970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jdv58" (UID: "2dbad3ae-1dde-4055-9c15-47fa09b1c18b") : secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:21.646080 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645906 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/15a72792-c48e-4843-a853-888cba7646a3-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.646080 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.645911 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.647594 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.647574 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f6c796b55-6rppj"] Jul 28 14:56:21.649803 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.649786 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/15a72792-c48e-4843-a853-888cba7646a3-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.659611 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.659589 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzknh\" (UniqueName: \"kubernetes.io/projected/15a72792-c48e-4843-a853-888cba7646a3-kube-api-access-kzknh\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn\" (UID: \"15a72792-c48e-4843-a853-888cba7646a3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.660120 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.660104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmspq\" (UniqueName: \"kubernetes.io/projected/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-kube-api-access-fmspq\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:21.746629 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746594 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd74425-afae-4808-a442-c4ec82f416d9-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.746629 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-stats-auth\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.746853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.746853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:21.746853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd74425-afae-4808-a442-c4ec82f416d9-service-ca-bundle\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.746853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-default-certificate\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.746853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dd74425-afae-4808-a442-c4ec82f416d9-tmp\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.746853 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dd74425-afae-4808-a442-c4ec82f416d9-serving-cert\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.746853 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:21.746801 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:22.246780481 +0000 UTC m=+63.490719523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : configmap references non-existent config key: service-ca.crt Jul 28 14:56:21.747190 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9znvq\" (UniqueName: \"kubernetes.io/projected/00e0aa4c-b35f-4423-866c-72612c0498fe-kube-api-access-9znvq\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.747190 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6czfh\" (UniqueName: \"kubernetes.io/projected/2dd74425-afae-4808-a442-c4ec82f416d9-kube-api-access-6czfh\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.747190 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.746972 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2dd74425-afae-4808-a442-c4ec82f416d9-snapshots\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.747190 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.747020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvvtx\" (UniqueName: \"kubernetes.io/projected/db8de329-1652-4e2c-9d1a-07c503825b60-kube-api-access-hvvtx\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:21.747190 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.747066 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.747190 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:21.747186 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 14:56:21.747509 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:21.747253 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:22.247235855 +0000 UTC m=+63.491174890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : secret "router-metrics-certs-default" not found Jul 28 14:56:21.747509 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.747323 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd74425-afae-4808-a442-c4ec82f416d9-service-ca-bundle\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.747623 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.747566 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2dd74425-afae-4808-a442-c4ec82f416d9-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.747623 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.747613 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2dd74425-afae-4808-a442-c4ec82f416d9-tmp\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.747721 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.747655 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2dd74425-afae-4808-a442-c4ec82f416d9-snapshots\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.747721 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:21.747684 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 14:56:21.747786 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:21.747730 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls podName:db8de329-1652-4e2c-9d1a-07c503825b60 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:22.247716814 +0000 UTC m=+63.491655854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls") pod "cluster-samples-operator-6748489656-kflpj" (UID: "db8de329-1652-4e2c-9d1a-07c503825b60") : secret "samples-operator-tls" not found Jul 28 14:56:21.749206 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.749185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2dd74425-afae-4808-a442-c4ec82f416d9-serving-cert\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.749587 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.749570 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-default-certificate\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.749721 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.749702 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-stats-auth\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.757237 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.757176 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czfh\" (UniqueName: \"kubernetes.io/projected/2dd74425-afae-4808-a442-c4ec82f416d9-kube-api-access-6czfh\") pod \"insights-operator-5885fdb759-569lv\" (UID: \"2dd74425-afae-4808-a442-c4ec82f416d9\") " pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.757703 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.757682 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvvtx\" (UniqueName: \"kubernetes.io/projected/db8de329-1652-4e2c-9d1a-07c503825b60-kube-api-access-hvvtx\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:21.758436 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.758420 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9znvq\" (UniqueName: \"kubernetes.io/projected/00e0aa4c-b35f-4423-866c-72612c0498fe-kube-api-access-9znvq\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:21.819796 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.819773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" Jul 28 14:56:21.929403 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.929197 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-569lv" Jul 28 14:56:21.960142 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:21.960114 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn"] Jul 28 14:56:21.963409 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:21.963386 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a72792_c48e_4843_a853_888cba7646a3.slice/crio-d115bfd527f03cb9543068557991761621fac1414546425268596110e53619ab WatchSource:0}: Error finding container d115bfd527f03cb9543068557991761621fac1414546425268596110e53619ab: Status 404 returned error can't find the container with id d115bfd527f03cb9543068557991761621fac1414546425268596110e53619ab Jul 28 14:56:22.050961 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:22.050888 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-569lv"] Jul 28 14:56:22.054800 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:22.054776 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd74425_afae_4808_a442_c4ec82f416d9.slice/crio-99cf767c149fac0499b85b55c25e23b78638bef93a653c0a3547f5033cbdaaec WatchSource:0}: Error finding container 99cf767c149fac0499b85b55c25e23b78638bef93a653c0a3547f5033cbdaaec: Status 404 returned error can't find the container with id 99cf767c149fac0499b85b55c25e23b78638bef93a653c0a3547f5033cbdaaec Jul 28 14:56:22.150262 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:22.150231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:22.150417 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:22.150342 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:22.150417 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:22.150392 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls podName:2dbad3ae-1dde-4055-9c15-47fa09b1c18b nodeName:}" failed. No retries permitted until 2026-07-28 14:56:23.150379281 +0000 UTC m=+64.394318304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jdv58" (UID: "2dbad3ae-1dde-4055-9c15-47fa09b1c18b") : secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:22.251372 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:22.251340 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:22.251529 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:22.251381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:22.251529 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:22.251500 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 14:56:22.251600 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:22.251540 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls podName:db8de329-1652-4e2c-9d1a-07c503825b60 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:23.251526707 +0000 UTC m=+64.495465730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls") pod "cluster-samples-operator-6748489656-kflpj" (UID: "db8de329-1652-4e2c-9d1a-07c503825b60") : secret "samples-operator-tls" not found Jul 28 14:56:22.251600 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:22.251552 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:23.251546327 +0000 UTC m=+64.495485349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : configmap references non-existent config key: service-ca.crt Jul 28 14:56:22.251674 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:22.251602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:22.251674 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:22.251671 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 14:56:22.251730 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:22.251697 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:23.251690296 +0000 UTC m=+64.495629318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : secret "router-metrics-certs-default" not found Jul 28 14:56:22.835076 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:22.835038 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-569lv" event={"ID":"2dd74425-afae-4808-a442-c4ec82f416d9","Type":"ContainerStarted","Data":"99cf767c149fac0499b85b55c25e23b78638bef93a653c0a3547f5033cbdaaec"} Jul 28 14:56:22.836633 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:22.836599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" event={"ID":"15a72792-c48e-4843-a853-888cba7646a3","Type":"ContainerStarted","Data":"d115bfd527f03cb9543068557991761621fac1414546425268596110e53619ab"} Jul 28 14:56:23.158719 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:23.158671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:23.158887 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:23.158851 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:23.158940 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:23.158930 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls podName:2dbad3ae-1dde-4055-9c15-47fa09b1c18b nodeName:}" failed. No retries permitted until 2026-07-28 14:56:25.158911555 +0000 UTC m=+66.402850581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jdv58" (UID: "2dbad3ae-1dde-4055-9c15-47fa09b1c18b") : secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:23.259502 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:23.259468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:23.259679 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:23.259518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:23.259679 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:23.259611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:23.259679 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:23.259636 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:25.259612668 +0000 UTC m=+66.503551691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : configmap references non-existent config key: service-ca.crt Jul 28 14:56:23.259933 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:23.259689 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 14:56:23.259933 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:23.259736 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:25.259722455 +0000 UTC m=+66.503661478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : secret "router-metrics-certs-default" not found Jul 28 14:56:23.259933 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:23.259689 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 14:56:23.259933 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:23.259781 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls podName:db8de329-1652-4e2c-9d1a-07c503825b60 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:25.259771567 +0000 UTC m=+66.503710590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls") pod "cluster-samples-operator-6748489656-kflpj" (UID: "db8de329-1652-4e2c-9d1a-07c503825b60") : secret "samples-operator-tls" not found Jul 28 14:56:24.843737 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:24.843639 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" event={"ID":"15a72792-c48e-4843-a853-888cba7646a3","Type":"ContainerStarted","Data":"dd58dadf633bd93113f5522307e66d494d489d51553fa86939c630145860cb58"} Jul 28 14:56:24.845194 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:24.845168 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-569lv" event={"ID":"2dd74425-afae-4808-a442-c4ec82f416d9","Type":"ContainerStarted","Data":"0b310b905445508e2b54c3cf19c04b821c1949e2f4fce1c5c7635fc97c5be1fe"} Jul 28 14:56:24.862271 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:24.862226 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" podStartSLOduration=1.390771421 podStartE2EDuration="3.862214486s" totalImagesPullingTime="2.471443065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:56:24.861263208 +0000 UTC m=+66.105202253" watchObservedRunningTime="2026-07-28 14:56:24.862214486 +0000 UTC m=+66.106153530" Jul 28 14:56:24.880084 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:24.880034 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-569lv" podStartSLOduration=1.498175096 podStartE2EDuration="3.880015251s" totalImagesPullingTime="2.381840155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:56:24.878679597 +0000 UTC m=+66.122618647" watchObservedRunningTime="2026-07-28 14:56:24.880015251 +0000 UTC m=+66.123954298" Jul 28 14:56:25.076112 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.076069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:56:25.076301 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.076127 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:56:25.076301 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.076153 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:56:25.078498 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.078478 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 14:56:25.078498 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.078486 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 14:56:25.078614 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.078510 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 14:56:25.087221 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.087198 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 14:56:25.087315 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.087262 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs podName:a4296243-f2f2-41db-b931-eb6e89110195 nodeName:}" failed. No retries permitted until 2026-07-28 14:57:29.087242939 +0000 UTC m=+130.331181963 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs") pod "network-metrics-daemon-246q4" (UID: "a4296243-f2f2-41db-b931-eb6e89110195") : secret "metrics-daemon-secret" not found Jul 28 14:56:25.089175 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.089157 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 14:56:25.089397 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.089380 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165-original-pull-secret\") pod \"global-pull-secret-syncer-5twhq\" (UID: \"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165\") " pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:56:25.100427 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.100367 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9bc\" (UniqueName: \"kubernetes.io/projected/22d5e416-87ce-47db-9b63-341066302104-kube-api-access-jr9bc\") pod \"network-check-target-kfhzq\" (UID: \"22d5e416-87ce-47db-9b63-341066302104\") " pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:56:25.176984 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.176940 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:25.177163 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.177093 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:25.177221 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.177172 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls podName:2dbad3ae-1dde-4055-9c15-47fa09b1c18b nodeName:}" failed. No retries permitted until 2026-07-28 14:56:29.17715519 +0000 UTC m=+70.421094213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jdv58" (UID: "2dbad3ae-1dde-4055-9c15-47fa09b1c18b") : secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:25.277581 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.277543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:25.277759 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.277598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:25.277759 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.277638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:25.277759 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.277679 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 14:56:25.277759 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.277741 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:29.277725594 +0000 UTC m=+70.521664618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : secret "router-metrics-certs-default" not found Jul 28 14:56:25.277759 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.277757 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 14:56:25.278014 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.277759 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:29.277750479 +0000 UTC m=+70.521689501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : configmap references non-existent config key: service-ca.crt Jul 28 14:56:25.278014 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.277812 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls podName:db8de329-1652-4e2c-9d1a-07c503825b60 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:29.27779733 +0000 UTC m=+70.521736353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls") pod "cluster-samples-operator-6748489656-kflpj" (UID: "db8de329-1652-4e2c-9d1a-07c503825b60") : secret "samples-operator-tls" not found Jul 28 14:56:25.283275 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.283258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5twhq" Jul 28 14:56:25.291586 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.291565 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z2klb\"" Jul 28 14:56:25.298794 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.298769 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:56:25.423077 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.423048 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5twhq"] Jul 28 14:56:25.426653 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:25.426627 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcab16c8_c85a_4c5f_9bb2_2d0e5c97d165.slice/crio-c73d48a61e565da66ef3a85660d87024d3502bcc497c01dc705700feaeb5d86e WatchSource:0}: Error finding container c73d48a61e565da66ef3a85660d87024d3502bcc497c01dc705700feaeb5d86e: Status 404 returned error can't find the container with id c73d48a61e565da66ef3a85660d87024d3502bcc497c01dc705700feaeb5d86e Jul 28 14:56:25.442612 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.442588 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kfhzq"] Jul 28 14:56:25.445801 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:25.445781 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d5e416_87ce_47db_9b63_341066302104.slice/crio-04803a43009562f9553f258c3c33fb6dcf20fe3f85d688955451f2062ee75afc WatchSource:0}: Error finding container 04803a43009562f9553f258c3c33fb6dcf20fe3f85d688955451f2062ee75afc: Status 404 returned error can't find the container with id 04803a43009562f9553f258c3c33fb6dcf20fe3f85d688955451f2062ee75afc Jul 28 14:56:25.730047 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.730003 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nvmct"] Jul 28 14:56:25.735504 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.735475 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.737676 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.737647 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 14:56:25.737791 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.737763 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 14:56:25.737860 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.737813 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5gtwh\"" Jul 28 14:56:25.773659 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.773631 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nvmct"] Jul 28 14:56:25.781770 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.781745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.781894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.781776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65ef832d-c07f-44c0-ac5e-974c77ed07de-crio-socket\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.781894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.781794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ef832d-c07f-44c0-ac5e-974c77ed07de-data-volume\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.781969 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.781934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjwr8\" (UniqueName: \"kubernetes.io/projected/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-api-access-sjwr8\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.782003 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.781972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.849034 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.848996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5twhq" event={"ID":"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165","Type":"ContainerStarted","Data":"c73d48a61e565da66ef3a85660d87024d3502bcc497c01dc705700feaeb5d86e"} Jul 28 14:56:25.850671 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.850639 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kfhzq" event={"ID":"22d5e416-87ce-47db-9b63-341066302104","Type":"ContainerStarted","Data":"04803a43009562f9553f258c3c33fb6dcf20fe3f85d688955451f2062ee75afc"} Jul 28 14:56:25.882827 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.882803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjwr8\" (UniqueName: \"kubernetes.io/projected/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-api-access-sjwr8\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.883260 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.882891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.883355 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.882972 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 14:56:25.883414 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.883399 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:26.383376884 +0000 UTC m=+67.627315924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : configmap "kube-rbac-proxy" not found Jul 28 14:56:25.883666 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.883637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.883801 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.883778 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 14:56:25.883916 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:25.883836 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:26.383819585 +0000 UTC m=+67.627758614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : secret "insights-runtime-extractor-tls" not found Jul 28 14:56:25.883984 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.883967 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65ef832d-c07f-44c0-ac5e-974c77ed07de-crio-socket\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.884046 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.884025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65ef832d-c07f-44c0-ac5e-974c77ed07de-crio-socket\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.884091 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.884069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ef832d-c07f-44c0-ac5e-974c77ed07de-data-volume\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.884399 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.884375 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ef832d-c07f-44c0-ac5e-974c77ed07de-data-volume\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:25.894076 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:25.894050 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjwr8\" (UniqueName: \"kubernetes.io/projected/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-api-access-sjwr8\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:26.389402 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:26.389347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:26.389606 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:26.389515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:26.389606 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.389515 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 14:56:26.389606 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.389596 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 14:56:26.389769 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.389668 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:27.389645964 +0000 UTC m=+68.633585008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : secret "insights-runtime-extractor-tls" not found Jul 28 14:56:26.389769 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.389689 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:27.389679934 +0000 UTC m=+68.633618958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : configmap "kube-rbac-proxy" not found Jul 28 14:56:26.894337 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:26.894303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:56:26.894856 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:26.894428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:56:26.894856 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.894609 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 14:56:26.894856 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.894636 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df89c7686-jdjq8: secret "image-registry-tls" not found Jul 28 14:56:26.894856 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.894694 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls podName:ec32d959-770c-4665-90ce-da9329d42669 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:58.894675429 +0000 UTC m=+100.138614455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls") pod "image-registry-df89c7686-jdjq8" (UID: "ec32d959-770c-4665-90ce-da9329d42669") : secret "image-registry-tls" not found Jul 28 14:56:26.894856 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.894613 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 14:56:26.894856 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:26.894769 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls podName:fe15fa41-8f88-4009-86bf-e3182137eacb nodeName:}" failed. No retries permitted until 2026-07-28 14:56:58.89474945 +0000 UTC m=+100.138688484 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls") pod "dns-default-cqjcd" (UID: "fe15fa41-8f88-4009-86bf-e3182137eacb") : secret "dns-default-metrics-tls" not found Jul 28 14:56:27.209428 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:27.209385 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d99pr_8db45231-7e81-4ae8-bd6d-6156af2f68da/dns-node-resolver/0.log" Jul 28 14:56:27.399934 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:27.399898 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:27.400102 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:27.400029 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 14:56:27.400102 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:27.400097 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:29.400080846 +0000 UTC m=+70.644019869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : configmap "kube-rbac-proxy" not found Jul 28 14:56:27.400197 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:27.400115 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:27.400294 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:27.400278 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 14:56:27.400340 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:27.400322 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:29.40031064 +0000 UTC m=+70.644249665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : secret "insights-runtime-extractor-tls" not found Jul 28 14:56:28.404041 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.404014 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-82hgb_c63b8314-0511-457e-83a0-d65b438a79f1/node-ca/0.log" Jul 28 14:56:28.948511 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.948475 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-mg7wv"] Jul 28 14:56:28.971368 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.971325 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-mg7wv"] Jul 28 14:56:28.971556 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.971468 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:28.974037 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.974007 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 14:56:28.974037 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.974026 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 14:56:28.974037 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.974012 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 14:56:28.974240 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.974014 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 14:56:28.974817 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:28.974799 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sfhgl\"" Jul 28 14:56:29.004112 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.004084 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ftx8w_2ef4be95-b8a3-4fdd-9328-6b682672fad2/serve-healthcheck-canary/0.log" Jul 28 14:56:29.014818 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.014795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9dde6f91-1675-4b99-b75e-f097d87d6bed-signing-key\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.014952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.014851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmh28\" (UniqueName: \"kubernetes.io/projected/9dde6f91-1675-4b99-b75e-f097d87d6bed-kube-api-access-fmh28\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.015007 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.014975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9dde6f91-1675-4b99-b75e-f097d87d6bed-signing-cabundle\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.116394 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.116352 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9dde6f91-1675-4b99-b75e-f097d87d6bed-signing-cabundle\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.116617 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.116528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9dde6f91-1675-4b99-b75e-f097d87d6bed-signing-key\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.116617 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.116558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmh28\" (UniqueName: \"kubernetes.io/projected/9dde6f91-1675-4b99-b75e-f097d87d6bed-kube-api-access-fmh28\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.117168 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.117142 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9dde6f91-1675-4b99-b75e-f097d87d6bed-signing-cabundle\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.119093 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.119070 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9dde6f91-1675-4b99-b75e-f097d87d6bed-signing-key\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.126189 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.126167 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmh28\" (UniqueName: \"kubernetes.io/projected/9dde6f91-1675-4b99-b75e-f097d87d6bed-kube-api-access-fmh28\") pod \"service-ca-658d7b7c78-mg7wv\" (UID: \"9dde6f91-1675-4b99-b75e-f097d87d6bed\") " pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.217789 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.217705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:29.217945 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.217831 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:29.217945 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.217896 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls podName:2dbad3ae-1dde-4055-9c15-47fa09b1c18b nodeName:}" failed. No retries permitted until 2026-07-28 14:56:37.217879382 +0000 UTC m=+78.461818406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jdv58" (UID: "2dbad3ae-1dde-4055-9c15-47fa09b1c18b") : secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:29.281684 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.281643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" Jul 28 14:56:29.319235 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.319198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:29.319421 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.319278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:29.319421 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.319323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:29.319421 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.319346 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 14:56:29.319643 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.319425 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:37.319408474 +0000 UTC m=+78.563347509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : secret "router-metrics-certs-default" not found Jul 28 14:56:29.319643 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.319462 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 14:56:29.319643 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.319475 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:37.319439337 +0000 UTC m=+78.563378381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : configmap references non-existent config key: service-ca.crt Jul 28 14:56:29.319643 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.319510 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls podName:db8de329-1652-4e2c-9d1a-07c503825b60 nodeName:}" failed. No retries permitted until 2026-07-28 14:56:37.319498127 +0000 UTC m=+78.563437153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls") pod "cluster-samples-operator-6748489656-kflpj" (UID: "db8de329-1652-4e2c-9d1a-07c503825b60") : secret "samples-operator-tls" not found Jul 28 14:56:29.420352 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.420311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:29.420826 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:29.420434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:29.420826 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.420491 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 14:56:29.420826 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.420520 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 14:56:29.420826 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.420560 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:33.420541769 +0000 UTC m=+74.664480800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : secret "insights-runtime-extractor-tls" not found Jul 28 14:56:29.420826 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:29.420578 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:33.42056946 +0000 UTC m=+74.664508483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : configmap "kube-rbac-proxy" not found Jul 28 14:56:30.057462 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:30.057422 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-mg7wv"] Jul 28 14:56:30.060795 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:30.060772 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dde6f91_1675_4b99_b75e_f097d87d6bed.slice/crio-636d4b814f0b4d0e16043c3b76ffa0d901dcf60e9373fe387201edb03a8a3810 WatchSource:0}: Error finding container 636d4b814f0b4d0e16043c3b76ffa0d901dcf60e9373fe387201edb03a8a3810: Status 404 returned error can't find the container with id 636d4b814f0b4d0e16043c3b76ffa0d901dcf60e9373fe387201edb03a8a3810 Jul 28 14:56:30.867183 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:30.867144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kfhzq" event={"ID":"22d5e416-87ce-47db-9b63-341066302104","Type":"ContainerStarted","Data":"8a54f28df3f390c0016e2b43b3c073e30c482bef51b4941fbf001de038af7532"} Jul 28 14:56:30.867680 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:30.867262 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:56:30.868832 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:30.868802 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5twhq" event={"ID":"dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165","Type":"ContainerStarted","Data":"5228bb6e51c9321cbabb575406b766a139a7a88f5ac3274e476f70fcbff7a174"} Jul 28 14:56:30.869939 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:30.869911 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" event={"ID":"9dde6f91-1675-4b99-b75e-f097d87d6bed","Type":"ContainerStarted","Data":"636d4b814f0b4d0e16043c3b76ffa0d901dcf60e9373fe387201edb03a8a3810"} Jul 28 14:56:30.887554 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:30.887352 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kfhzq" podStartSLOduration=67.400174682 podStartE2EDuration="1m11.88733296s" totalImagesPullingTime="4.487158278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:56:30.886949769 +0000 UTC m=+72.130888805" watchObservedRunningTime="2026-07-28 14:56:30.88733296 +0000 UTC m=+72.131272003" Jul 28 14:56:30.905339 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:30.905285 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5twhq" podStartSLOduration=66.392499118 podStartE2EDuration="1m10.905265921s" totalImagesPullingTime="4.512766803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:56:30.904694724 +0000 UTC m=+72.148633769" watchObservedRunningTime="2026-07-28 14:56:30.905265921 +0000 UTC m=+72.149204967" Jul 28 14:56:32.877732 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:32.877694 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" event={"ID":"9dde6f91-1675-4b99-b75e-f097d87d6bed","Type":"ContainerStarted","Data":"57d7f52766a8e73b6cdd2c2e382d416a97ed127be6dbfa08cd9486bf2276cb1c"} Jul 28 14:56:32.896498 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:32.896434 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-mg7wv" podStartSLOduration=2.8689631540000002 podStartE2EDuration="4.8964191s" totalImagesPullingTime="2.027455946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:56:32.895576166 +0000 UTC m=+74.139515211" watchObservedRunningTime="2026-07-28 14:56:32.8964191 +0000 UTC m=+74.140358146" Jul 28 14:56:33.457092 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:33.457047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:33.457911 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:33.457180 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 14:56:33.457911 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:33.457408 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:33.457911 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:33.457456 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:41.457419555 +0000 UTC m=+82.701358582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : configmap "kube-rbac-proxy" not found Jul 28 14:56:33.457911 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:33.457531 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 14:56:33.457911 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:33.457582 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:41.457567768 +0000 UTC m=+82.701506798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : secret "insights-runtime-extractor-tls" not found Jul 28 14:56:37.291227 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:37.291189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:37.291644 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:37.291344 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:37.291644 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:37.291411 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls podName:2dbad3ae-1dde-4055-9c15-47fa09b1c18b nodeName:}" failed. No retries permitted until 2026-07-28 14:56:53.291395424 +0000 UTC m=+94.535334447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-jdv58" (UID: "2dbad3ae-1dde-4055-9c15-47fa09b1c18b") : secret "cluster-monitoring-operator-tls" not found Jul 28 14:56:37.391767 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:37.391729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:37.391940 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:37.391782 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:37.391940 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:37.391809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:37.391940 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:37.391890 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 14:56:37.392085 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:37.391959 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:53.391943161 +0000 UTC m=+94.635882184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : secret "router-metrics-certs-default" not found Jul 28 14:56:37.392085 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:37.391975 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle podName:00e0aa4c-b35f-4423-866c-72612c0498fe nodeName:}" failed. No retries permitted until 2026-07-28 14:56:53.391969838 +0000 UTC m=+94.635908860 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle") pod "router-default-5f6c796b55-6rppj" (UID: "00e0aa4c-b35f-4423-866c-72612c0498fe") : configmap references non-existent config key: service-ca.crt Jul 28 14:56:37.394241 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:37.394217 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/db8de329-1652-4e2c-9d1a-07c503825b60-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kflpj\" (UID: \"db8de329-1652-4e2c-9d1a-07c503825b60\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:37.520271 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:37.520232 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" Jul 28 14:56:37.647954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:37.647873 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj"] Jul 28 14:56:37.894906 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:37.894823 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" event={"ID":"db8de329-1652-4e2c-9d1a-07c503825b60","Type":"ContainerStarted","Data":"44a84566b28ec4b5952ebf97ec66b3dcaba6d39cf9f21659a81e6ffce76cc35f"} Jul 28 14:56:39.902861 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:39.902826 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" event={"ID":"db8de329-1652-4e2c-9d1a-07c503825b60","Type":"ContainerStarted","Data":"593d06172e436294ba52567e9d0397e8e115ee1ed617c09e886a0b14dac54a12"} Jul 28 14:56:39.903271 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:39.902885 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" event={"ID":"db8de329-1652-4e2c-9d1a-07c503825b60","Type":"ContainerStarted","Data":"0ff2d2778a85f2c65c9546212403e96f4a29dc1ffdf58ddde2d4a522053dee67"} Jul 28 14:56:39.922614 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:39.922561 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kflpj" podStartSLOduration=17.261453 podStartE2EDuration="18.922545272s" totalImagesPullingTime="1.661092272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:56:39.921015953 +0000 UTC m=+81.164954995" watchObservedRunningTime="2026-07-28 14:56:39.922545272 +0000 UTC m=+81.166484317" Jul 28 14:56:41.526245 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:41.526111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:41.526718 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:41.526332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:41.526718 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:41.526466 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 14:56:41.526718 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:41.526522 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls podName:65ef832d-c07f-44c0-ac5e-974c77ed07de nodeName:}" failed. No retries permitted until 2026-07-28 14:56:57.526509432 +0000 UTC m=+98.770448459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nvmct" (UID: "65ef832d-c07f-44c0-ac5e-974c77ed07de") : secret "insights-runtime-extractor-tls" not found Jul 28 14:56:41.526878 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:41.526772 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65ef832d-c07f-44c0-ac5e-974c77ed07de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:53.317955 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.317918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:53.320388 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.320354 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2dbad3ae-1dde-4055-9c15-47fa09b1c18b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-jdv58\" (UID: \"2dbad3ae-1dde-4055-9c15-47fa09b1c18b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:53.326115 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.326096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" Jul 28 14:56:53.419098 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.419061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:53.419232 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.419140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:53.419924 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.419870 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00e0aa4c-b35f-4423-866c-72612c0498fe-service-ca-bundle\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:53.422294 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.422271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00e0aa4c-b35f-4423-866c-72612c0498fe-metrics-certs\") pod \"router-default-5f6c796b55-6rppj\" (UID: \"00e0aa4c-b35f-4423-866c-72612c0498fe\") " pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:53.434258 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.434237 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:53.452774 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.452747 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58"] Jul 28 14:56:53.454988 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:53.454963 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbad3ae_1dde_4055_9c15_47fa09b1c18b.slice/crio-9fbe863e98c5710a8af722b655a8fcc0075d737e3849bb11eab8bdc5dff405f2 WatchSource:0}: Error finding container 9fbe863e98c5710a8af722b655a8fcc0075d737e3849bb11eab8bdc5dff405f2: Status 404 returned error can't find the container with id 9fbe863e98c5710a8af722b655a8fcc0075d737e3849bb11eab8bdc5dff405f2 Jul 28 14:56:53.561612 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.561579 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f6c796b55-6rppj"] Jul 28 14:56:53.564230 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:53.564205 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e0aa4c_b35f_4423_866c_72612c0498fe.slice/crio-039fe38692270d46d5934c30efd536537bb95b88bb800d47d9f282495d0492a1 WatchSource:0}: Error finding container 039fe38692270d46d5934c30efd536537bb95b88bb800d47d9f282495d0492a1: Status 404 returned error can't find the container with id 039fe38692270d46d5934c30efd536537bb95b88bb800d47d9f282495d0492a1 Jul 28 14:56:53.946168 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.946131 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" event={"ID":"2dbad3ae-1dde-4055-9c15-47fa09b1c18b","Type":"ContainerStarted","Data":"9fbe863e98c5710a8af722b655a8fcc0075d737e3849bb11eab8bdc5dff405f2"} Jul 28 14:56:53.947464 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.947426 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f6c796b55-6rppj" event={"ID":"00e0aa4c-b35f-4423-866c-72612c0498fe","Type":"ContainerStarted","Data":"fa3e4d6ac90b7165e53a2499aff85dc10512b71df77b41d14e731a26c78d7621"} Jul 28 14:56:53.947596 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.947475 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f6c796b55-6rppj" event={"ID":"00e0aa4c-b35f-4423-866c-72612c0498fe","Type":"ContainerStarted","Data":"039fe38692270d46d5934c30efd536537bb95b88bb800d47d9f282495d0492a1"} Jul 28 14:56:53.964678 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:53.964632 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f6c796b55-6rppj" podStartSLOduration=32.964617366 podStartE2EDuration="32.964617366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:56:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:56:53.963721283 +0000 UTC m=+95.207660327" watchObservedRunningTime="2026-07-28 14:56:53.964617366 +0000 UTC m=+95.208556412" Jul 28 14:56:54.434517 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:54.434484 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:54.437360 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:54.437337 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:54.951008 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:54.950972 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:54.952268 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:54.952241 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f6c796b55-6rppj" Jul 28 14:56:55.955189 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:55.955150 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" event={"ID":"2dbad3ae-1dde-4055-9c15-47fa09b1c18b","Type":"ContainerStarted","Data":"b57a10d66d4a254ef9ec2b6f01bfc07504888cf5cb4029a791571d3f6dcd2095"} Jul 28 14:56:55.970775 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:55.970728 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-jdv58" podStartSLOduration=33.252579885 podStartE2EDuration="34.970712721s" totalImagesPullingTime="1.718132836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:56:55.969689484 +0000 UTC m=+97.213628529" watchObservedRunningTime="2026-07-28 14:56:55.970712721 +0000 UTC m=+97.214651765" Jul 28 14:56:57.554409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:57.554374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:57.556653 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:57.556630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65ef832d-c07f-44c0-ac5e-974c77ed07de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nvmct\" (UID: \"65ef832d-c07f-44c0-ac5e-974c77ed07de\") " pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:57.844799 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:57.844706 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nvmct" Jul 28 14:56:57.967078 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:57.967047 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nvmct"] Jul 28 14:56:57.971241 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:57.971217 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ef832d_c07f_44c0_ac5e_974c77ed07de.slice/crio-e4b41ce579aba9cc670a5b5f01d9875c4de894ccf8efe923cdf10107f2808f16 WatchSource:0}: Error finding container e4b41ce579aba9cc670a5b5f01d9875c4de894ccf8efe923cdf10107f2808f16: Status 404 returned error can't find the container with id e4b41ce579aba9cc670a5b5f01d9875c4de894ccf8efe923cdf10107f2808f16 Jul 28 14:56:58.284052 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.284020 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bfb7f964b-b9p8r"] Jul 28 14:56:58.287613 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.287595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.289829 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.289808 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 14:56:58.289950 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.289882 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 14:56:58.289992 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.289882 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 14:56:58.290560 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.290536 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 14:56:58.290560 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.290539 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 14:56:58.290737 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.290681 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 14:56:58.290737 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.290711 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 14:56:58.290849 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.290832 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47c62\"" Jul 28 14:56:58.294834 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.294813 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 14:56:58.303420 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.303393 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfb7f964b-b9p8r"] Jul 28 14:56:58.463596 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.463564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-service-ca\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.463779 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.463620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-serving-cert\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.463779 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.463690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-config\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.463874 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.463779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdbnq\" (UniqueName: \"kubernetes.io/projected/a5355820-1193-4e8c-87b3-b4acf2ef30ac-kube-api-access-sdbnq\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.463874 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.463834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-trusted-ca-bundle\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.463959 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.463912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-oauth-config\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.463959 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.463941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-oauth-serving-cert\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.565266 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.565175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-serving-cert\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.565266 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.565225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-config\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.565848 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.565285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdbnq\" (UniqueName: \"kubernetes.io/projected/a5355820-1193-4e8c-87b3-b4acf2ef30ac-kube-api-access-sdbnq\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.565848 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.565333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-trusted-ca-bundle\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.565848 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.565391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-oauth-config\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.566281 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.566249 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-config\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.567665 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.566614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-oauth-serving-cert\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.567665 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.566696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-service-ca\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.567665 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.567338 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-service-ca\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.567665 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.567399 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-trusted-ca-bundle\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.568315 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.568290 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-oauth-serving-cert\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.575347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.575173 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-oauth-config\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.575347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.575306 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-serving-cert\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.578476 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.578414 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdbnq\" (UniqueName: \"kubernetes.io/projected/a5355820-1193-4e8c-87b3-b4acf2ef30ac-kube-api-access-sdbnq\") pod \"console-6bfb7f964b-b9p8r\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.598284 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.598132 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:56:58.771957 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.771880 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfb7f964b-b9p8r"] Jul 28 14:56:58.776499 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:58.776408 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5355820_1193_4e8c_87b3_b4acf2ef30ac.slice/crio-95345059ea0c273538a3fbd2bbaa9379afdb91bc3c972d97d2ebaef8214d58d5 WatchSource:0}: Error finding container 95345059ea0c273538a3fbd2bbaa9379afdb91bc3c972d97d2ebaef8214d58d5: Status 404 returned error can't find the container with id 95345059ea0c273538a3fbd2bbaa9379afdb91bc3c972d97d2ebaef8214d58d5 Jul 28 14:56:58.968691 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.968620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfb7f964b-b9p8r" event={"ID":"a5355820-1193-4e8c-87b3-b4acf2ef30ac","Type":"ContainerStarted","Data":"95345059ea0c273538a3fbd2bbaa9379afdb91bc3c972d97d2ebaef8214d58d5"} Jul 28 14:56:58.970127 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.970058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nvmct" event={"ID":"65ef832d-c07f-44c0-ac5e-974c77ed07de","Type":"ContainerStarted","Data":"e4b41ce579aba9cc670a5b5f01d9875c4de894ccf8efe923cdf10107f2808f16"} Jul 28 14:56:58.974732 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.974697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:56:58.974871 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.974781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:56:58.977476 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.977436 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fe15fa41-8f88-4009-86bf-e3182137eacb-metrics-tls\") pod \"dns-default-cqjcd\" (UID: \"fe15fa41-8f88-4009-86bf-e3182137eacb\") " pod="openshift-dns/dns-default-cqjcd" Jul 28 14:56:58.977711 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:58.977685 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"image-registry-df89c7686-jdjq8\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:56:59.258687 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.258589 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xps6j\"" Jul 28 14:56:59.266776 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.266746 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:56:59.274503 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.274457 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b9z8t\"" Jul 28 14:56:59.283292 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.283241 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cqjcd" Jul 28 14:56:59.478087 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.478042 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df89c7686-jdjq8"] Jul 28 14:56:59.482129 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:56:59.482091 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec32d959_770c_4665_90ce_da9329d42669.slice/crio-be2786e47d33e96c7e9ade3f511a65d8b9338b84458c6145c3b9b226ec2ac925 WatchSource:0}: Error finding container be2786e47d33e96c7e9ade3f511a65d8b9338b84458c6145c3b9b226ec2ac925: Status 404 returned error can't find the container with id be2786e47d33e96c7e9ade3f511a65d8b9338b84458c6145c3b9b226ec2ac925 Jul 28 14:56:59.504872 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.504848 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cqjcd"] Jul 28 14:56:59.721166 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.719856 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pz5lh"] Jul 28 14:56:59.724076 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.723438 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.726488 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.725985 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-856wx\"" Jul 28 14:56:59.726488 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.726077 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 14:56:59.726488 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.726275 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 28 14:56:59.726488 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.726335 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 28 14:56:59.739354 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.739276 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pz5lh"] Jul 28 14:56:59.786128 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.785803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.786128 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.785917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74080a10-7a94-4264-881c-381838974960-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.786128 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.785953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56gjz\" (UniqueName: \"kubernetes.io/projected/74080a10-7a94-4264-881c-381838974960-kube-api-access-56gjz\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.786128 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.785983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.888494 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.886779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56gjz\" (UniqueName: \"kubernetes.io/projected/74080a10-7a94-4264-881c-381838974960-kube-api-access-56gjz\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.888494 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.886833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.888494 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.886865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.888494 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.886964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74080a10-7a94-4264-881c-381838974960-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.888494 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.887758 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74080a10-7a94-4264-881c-381838974960-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.888494 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:59.888161 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 28 14:56:59.888494 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:56:59.888221 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-tls podName:74080a10-7a94-4264-881c-381838974960 nodeName:}" failed. No retries permitted until 2026-07-28 14:57:00.388202885 +0000 UTC m=+101.632141911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-pz5lh" (UID: "74080a10-7a94-4264-881c-381838974960") : secret "prometheus-operator-tls" not found Jul 28 14:56:59.892173 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.892111 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.896522 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.896498 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56gjz\" (UniqueName: \"kubernetes.io/projected/74080a10-7a94-4264-881c-381838974960-kube-api-access-56gjz\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:56:59.983586 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.982951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" event={"ID":"ec32d959-770c-4665-90ce-da9329d42669","Type":"ContainerStarted","Data":"47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8"} Jul 28 14:56:59.983586 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.983018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" event={"ID":"ec32d959-770c-4665-90ce-da9329d42669","Type":"ContainerStarted","Data":"be2786e47d33e96c7e9ade3f511a65d8b9338b84458c6145c3b9b226ec2ac925"} Jul 28 14:56:59.983892 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.983606 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:56:59.985080 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:56:59.985010 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cqjcd" event={"ID":"fe15fa41-8f88-4009-86bf-e3182137eacb","Type":"ContainerStarted","Data":"fa3b300d4b8b2e1670d37ccaba6a938849a635453393a4a427b54d1eff4053b4"} Jul 28 14:57:00.391715 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:00.391677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:57:00.405340 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:00.405261 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/74080a10-7a94-4264-881c-381838974960-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pz5lh\" (UID: \"74080a10-7a94-4264-881c-381838974960\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:57:00.638842 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:00.638727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" Jul 28 14:57:00.803859 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:00.802935 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" podStartSLOduration=100.802910952 podStartE2EDuration="1m40.802910952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:00.003894617 +0000 UTC m=+101.247833674" watchObservedRunningTime="2026-07-28 14:57:00.802910952 +0000 UTC m=+102.046849998" Jul 28 14:57:00.805231 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:00.805200 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pz5lh"] Jul 28 14:57:00.809237 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:57:00.809209 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74080a10_7a94_4264_881c_381838974960.slice/crio-165f3975871fba1caba869fad4ca9f993d1c258fbcf45f1730be73ea5c3b05f1 WatchSource:0}: Error finding container 165f3975871fba1caba869fad4ca9f993d1c258fbcf45f1730be73ea5c3b05f1: Status 404 returned error can't find the container with id 165f3975871fba1caba869fad4ca9f993d1c258fbcf45f1730be73ea5c3b05f1 Jul 28 14:57:00.990151 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:00.990105 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" event={"ID":"74080a10-7a94-4264-881c-381838974960","Type":"ContainerStarted","Data":"165f3975871fba1caba869fad4ca9f993d1c258fbcf45f1730be73ea5c3b05f1"} Jul 28 14:57:01.876381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:01.876351 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kfhzq" Jul 28 14:57:07.011291 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:07.011240 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfb7f964b-b9p8r" event={"ID":"a5355820-1193-4e8c-87b3-b4acf2ef30ac","Type":"ContainerStarted","Data":"9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de"} Jul 28 14:57:07.013318 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:07.013290 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cqjcd" event={"ID":"fe15fa41-8f88-4009-86bf-e3182137eacb","Type":"ContainerStarted","Data":"9ca2c4b6357a20a8350d4029bad826e7a42389f8bf345e6bcd7f7d68f268032b"} Jul 28 14:57:07.013409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:07.013343 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cqjcd" event={"ID":"fe15fa41-8f88-4009-86bf-e3182137eacb","Type":"ContainerStarted","Data":"0c6a7e8191cb0f3ac55b15a7e3542a4ad0fc23572680dfd23771e2de5f6381ff"} Jul 28 14:57:07.013409 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:07.013378 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cqjcd" Jul 28 14:57:07.037222 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:07.037165 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bfb7f964b-b9p8r" podStartSLOduration=1.48418059 podStartE2EDuration="9.037144036s" totalImagesPullingTime="7.552963446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:07.037015479 +0000 UTC m=+108.280954524" watchObservedRunningTime="2026-07-28 14:57:07.037144036 +0000 UTC m=+108.281083081" Jul 28 14:57:07.053893 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:07.053851 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cqjcd" podStartSLOduration=65.245446787 podStartE2EDuration="1m12.053835591s" totalImagesPullingTime="6.808388804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:07.052887823 +0000 UTC m=+108.296826889" watchObservedRunningTime="2026-07-28 14:57:07.053835591 +0000 UTC m=+108.297774636" Jul 28 14:57:08.022925 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:08.022677 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" event={"ID":"74080a10-7a94-4264-881c-381838974960","Type":"ContainerStarted","Data":"2dfd450e487519d2c1a03138293e1656cf94eb82351c7d0d6cc0bf2e2917268d"} Jul 28 14:57:08.022925 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:08.022766 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" event={"ID":"74080a10-7a94-4264-881c-381838974960","Type":"ContainerStarted","Data":"d28d81dc495590f322c13529106656f9741189c9845dcba9d5a6ffe0c07ca268"} Jul 28 14:57:08.024537 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:08.024432 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nvmct" event={"ID":"65ef832d-c07f-44c0-ac5e-974c77ed07de","Type":"ContainerStarted","Data":"8802e1e24dce7b8cd792e4ad4174c7217f5d76837529f81ea120f2923b1e36e0"} Jul 28 14:57:08.040256 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:08.039554 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-pz5lh" podStartSLOduration=2.8963927739999997 podStartE2EDuration="9.039533962s" totalImagesPullingTime="6.143141188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:08.039341216 +0000 UTC m=+109.283280263" watchObservedRunningTime="2026-07-28 14:57:08.039533962 +0000 UTC m=+109.283473009" Jul 28 14:57:08.598737 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:08.598696 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:57:08.598873 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:08.598797 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:57:08.600293 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:08.600244 2561 patch_prober.go:28] interesting pod/console-6bfb7f964b-b9p8r container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Jul 28 14:57:08.600412 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:08.600314 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6bfb7f964b-b9p8r" podUID="a5355820-1193-4e8c-87b3-b4acf2ef30ac" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Jul 28 14:57:10.080257 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.080221 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz"] Jul 28 14:57:10.091154 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.091126 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.100217 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.099846 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 14:57:10.100217 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.100076 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 14:57:10.102454 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.102414 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz"] Jul 28 14:57:10.114474 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.110788 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jdnzk\"" Jul 28 14:57:10.114474 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.113035 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gblh7"] Jul 28 14:57:10.119470 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.118982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.125763 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.123813 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4b95r\"" Jul 28 14:57:10.125763 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.124035 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 14:57:10.125763 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.124039 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 14:57:10.125763 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.124236 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 14:57:10.178781 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-textfile\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.178781 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-sys\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.178781 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178797 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-wtmp\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.179074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178830 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c665a4-63c1-49cb-8944-19ef4857a2f0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.179074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-root\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.179074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93c665a4-63c1-49cb-8944-19ef4857a2f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.179074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-tls\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.179074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmr4\" (UniqueName: \"kubernetes.io/projected/611b91b1-374b-4942-8cf2-e030d66f210a-kube-api-access-gcmr4\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.179074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.178979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c665a4-63c1-49cb-8944-19ef4857a2f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.179074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.179033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgd47\" (UniqueName: \"kubernetes.io/projected/93c665a4-63c1-49cb-8944-19ef4857a2f0-kube-api-access-pgd47\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.179074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.179069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-accelerators-collector-config\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.179476 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.179104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.179476 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.179147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611b91b1-374b-4942-8cf2-e030d66f210a-metrics-client-ca\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.280625 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-textfile\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.280625 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-sys\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.280625 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-wtmp\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c665a4-63c1-49cb-8944-19ef4857a2f0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-root\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93c665a4-63c1-49cb-8944-19ef4857a2f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280749 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-sys\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-tls\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280816 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-root\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmr4\" (UniqueName: \"kubernetes.io/projected/611b91b1-374b-4942-8cf2-e030d66f210a-kube-api-access-gcmr4\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c665a4-63c1-49cb-8944-19ef4857a2f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgd47\" (UniqueName: \"kubernetes.io/projected/93c665a4-63c1-49cb-8944-19ef4857a2f0-kube-api-access-pgd47\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280952 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-accelerators-collector-config\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280959 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-textfile\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.280985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.281347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.281025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611b91b1-374b-4942-8cf2-e030d66f210a-metrics-client-ca\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.282036 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.281459 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-wtmp\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.282036 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.281549 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93c665a4-63c1-49cb-8944-19ef4857a2f0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.282036 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:57:10.281651 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 14:57:10.282036 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:57:10.281722 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-tls podName:611b91b1-374b-4942-8cf2-e030d66f210a nodeName:}" failed. No retries permitted until 2026-07-28 14:57:10.781702422 +0000 UTC m=+112.025641458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-tls") pod "node-exporter-gblh7" (UID: "611b91b1-374b-4942-8cf2-e030d66f210a") : secret "node-exporter-tls" not found Jul 28 14:57:10.282036 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.281988 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611b91b1-374b-4942-8cf2-e030d66f210a-metrics-client-ca\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.282036 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.282024 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-accelerators-collector-config\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.283845 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.283820 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93c665a4-63c1-49cb-8944-19ef4857a2f0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.284006 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.283985 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93c665a4-63c1-49cb-8944-19ef4857a2f0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.284680 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.284657 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.298977 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.298947 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmr4\" (UniqueName: \"kubernetes.io/projected/611b91b1-374b-4942-8cf2-e030d66f210a-kube-api-access-gcmr4\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.300858 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.300831 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgd47\" (UniqueName: \"kubernetes.io/projected/93c665a4-63c1-49cb-8944-19ef4857a2f0-kube-api-access-pgd47\") pod \"openshift-state-metrics-b8f49f5c6-qjgqz\" (UID: \"93c665a4-63c1-49cb-8944-19ef4857a2f0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.415135 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.415096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" Jul 28 14:57:10.741569 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.741542 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz"] Jul 28 14:57:10.745217 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:57:10.745190 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c665a4_63c1_49cb_8944_19ef4857a2f0.slice/crio-7d86b56da47a8a7f714513a3f4cbef0bad0f86f3c0daef4fa7c9666cc0ab5572 WatchSource:0}: Error finding container 7d86b56da47a8a7f714513a3f4cbef0bad0f86f3c0daef4fa7c9666cc0ab5572: Status 404 returned error can't find the container with id 7d86b56da47a8a7f714513a3f4cbef0bad0f86f3c0daef4fa7c9666cc0ab5572 Jul 28 14:57:10.785160 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.785120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-tls\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:10.787286 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:10.787263 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/611b91b1-374b-4942-8cf2-e030d66f210a-node-exporter-tls\") pod \"node-exporter-gblh7\" (UID: \"611b91b1-374b-4942-8cf2-e030d66f210a\") " pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:11.032436 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:11.032342 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gblh7" Jul 28 14:57:11.044223 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:11.044187 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nvmct" event={"ID":"65ef832d-c07f-44c0-ac5e-974c77ed07de","Type":"ContainerStarted","Data":"05b122eae79041b61d0d0ba8fe8122777bdff6632b17b3fd02085d8f5f731bbe"} Jul 28 14:57:11.046027 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:57:11.045995 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611b91b1_374b_4942_8cf2_e030d66f210a.slice/crio-4dfcce1579e179007480faec889ec6ccab96524bf2db30e00817abba5557d0e8 WatchSource:0}: Error finding container 4dfcce1579e179007480faec889ec6ccab96524bf2db30e00817abba5557d0e8: Status 404 returned error can't find the container with id 4dfcce1579e179007480faec889ec6ccab96524bf2db30e00817abba5557d0e8 Jul 28 14:57:11.046230 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:11.046208 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" event={"ID":"93c665a4-63c1-49cb-8944-19ef4857a2f0","Type":"ContainerStarted","Data":"a922684c9809a708c4b205d9aa93b44ea16bcb9635491d6be43e4c7a0c28cf30"} Jul 28 14:57:11.046281 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:11.046257 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" event={"ID":"93c665a4-63c1-49cb-8944-19ef4857a2f0","Type":"ContainerStarted","Data":"465edc2c65b47d017be0fe235ba2e61b5098154ebcb270c3793a00bd27ae708d"} Jul 28 14:57:11.046281 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:11.046275 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" event={"ID":"93c665a4-63c1-49cb-8944-19ef4857a2f0","Type":"ContainerStarted","Data":"7d86b56da47a8a7f714513a3f4cbef0bad0f86f3c0daef4fa7c9666cc0ab5572"} Jul 28 14:57:12.053341 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.053299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gblh7" event={"ID":"611b91b1-374b-4942-8cf2-e030d66f210a","Type":"ContainerStarted","Data":"4dfcce1579e179007480faec889ec6ccab96524bf2db30e00817abba5557d0e8"} Jul 28 14:57:12.136151 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.136056 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-9466c66-cq659"] Jul 28 14:57:12.142917 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.142884 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.146495 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.146462 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-csfxl\"" Jul 28 14:57:12.146651 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.146582 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a1i7853sg2vq0\"" Jul 28 14:57:12.146889 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.146867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 14:57:12.147985 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.147918 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 14:57:12.156088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.155817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 14:57:12.156088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.155969 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 14:57:12.156088 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.156054 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 14:57:12.178278 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.178175 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9466c66-cq659"] Jul 28 14:57:12.210843 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.210795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.211114 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.210847 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-tls\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.211114 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.210930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-grpc-tls\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.211114 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.210963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.211114 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.210998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.211114 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.211023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.211114 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.211048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-metrics-client-ca\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.211114 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.211090 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8z92\" (UniqueName: \"kubernetes.io/projected/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-kube-api-access-p8z92\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.311677 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.311603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-tls\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.311831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.311693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-grpc-tls\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.311831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.311732 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.311831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.311769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.311831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.311798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.311831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.311825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-metrics-client-ca\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.312134 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.311866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8z92\" (UniqueName: \"kubernetes.io/projected/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-kube-api-access-p8z92\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.312134 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.311927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.313063 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.312955 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-metrics-client-ca\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.314728 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.314697 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-tls\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.314728 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.314753 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.315199 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.315154 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.315291 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.315279 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.315395 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.315371 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-grpc-tls\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.316067 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.316047 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.320198 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.320168 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8z92\" (UniqueName: \"kubernetes.io/projected/6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888-kube-api-access-p8z92\") pod \"thanos-querier-9466c66-cq659\" (UID: \"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888\") " pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.455905 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.455675 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:12.617147 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:12.617051 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-9466c66-cq659"] Jul 28 14:57:12.619980 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:57:12.619948 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2c2db4_76f4_4eb8_b9f2_aa0be3e1f888.slice/crio-861bdb9dfede55235221cc93f505fbe060838b537edc049c09654f4f8c0ce22f WatchSource:0}: Error finding container 861bdb9dfede55235221cc93f505fbe060838b537edc049c09654f4f8c0ce22f: Status 404 returned error can't find the container with id 861bdb9dfede55235221cc93f505fbe060838b537edc049c09654f4f8c0ce22f Jul 28 14:57:13.060164 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:13.060122 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" event={"ID":"93c665a4-63c1-49cb-8944-19ef4857a2f0","Type":"ContainerStarted","Data":"78bc56f4838bfb3f56e1235ca62d635ed5a01ee980f39a895427546fa36d2f04"} Jul 28 14:57:13.062407 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:13.062379 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9466c66-cq659" event={"ID":"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888","Type":"ContainerStarted","Data":"861bdb9dfede55235221cc93f505fbe060838b537edc049c09654f4f8c0ce22f"} Jul 28 14:57:13.064387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:13.064333 2561 generic.go:356] "Generic (PLEG): container finished" podID="611b91b1-374b-4942-8cf2-e030d66f210a" containerID="9c0a5cc102b601f407dc9ae7ad745fc27697d873274ec55977bd01501432b1a8" exitCode=0 Jul 28 14:57:13.064544 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:13.064381 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gblh7" event={"ID":"611b91b1-374b-4942-8cf2-e030d66f210a","Type":"ContainerDied","Data":"9c0a5cc102b601f407dc9ae7ad745fc27697d873274ec55977bd01501432b1a8"} Jul 28 14:57:13.081093 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:13.081042 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-qjgqz" podStartSLOduration=1.608764039 podStartE2EDuration="3.081023261s" totalImagesPullingTime="1.472259222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:13.07895401 +0000 UTC m=+114.322893057" watchObservedRunningTime="2026-07-28 14:57:13.081023261 +0000 UTC m=+114.324962308" Jul 28 14:57:14.533051 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.533017 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr"] Jul 28 14:57:14.559017 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.558987 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr"] Jul 28 14:57:14.559201 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.559096 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.562161 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.562133 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 14:57:14.562316 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.562194 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 14:57:14.562316 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.562134 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 14:57:14.562316 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.562228 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 14:57:14.562752 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.562531 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-60pdktvi27p9k\"" Jul 28 14:57:14.562752 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.562583 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kp974\"" Jul 28 14:57:14.631728 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.631699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-client-ca-bundle\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.631894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.631756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-secret-metrics-server-tls\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.631894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.631799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaf84110-9953-4139-a878-088953999daa-metrics-server-audit-profiles\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.631894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.631822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaf84110-9953-4139-a878-088953999daa-audit-log\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.631894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.631846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-secret-metrics-server-client-certs\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.631894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.631881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mfl4\" (UniqueName: \"kubernetes.io/projected/eaf84110-9953-4139-a878-088953999daa-kube-api-access-6mfl4\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.632074 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.631905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf84110-9953-4139-a878-088953999daa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.732873 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.732845 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaf84110-9953-4139-a878-088953999daa-audit-log\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.732981 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.732891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-secret-metrics-server-client-certs\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.732981 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.732924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mfl4\" (UniqueName: \"kubernetes.io/projected/eaf84110-9953-4139-a878-088953999daa-kube-api-access-6mfl4\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.732981 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.732959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf84110-9953-4139-a878-088953999daa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.733205 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.733023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-client-ca-bundle\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.733205 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.733078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-secret-metrics-server-tls\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.733205 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.733134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaf84110-9953-4139-a878-088953999daa-metrics-server-audit-profiles\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.733420 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.733228 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/eaf84110-9953-4139-a878-088953999daa-audit-log\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.733956 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.733926 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaf84110-9953-4139-a878-088953999daa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.734184 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.734137 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/eaf84110-9953-4139-a878-088953999daa-metrics-server-audit-profiles\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.736134 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.736100 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-client-ca-bundle\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.736230 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.736186 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-secret-metrics-server-tls\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.736285 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.736232 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/eaf84110-9953-4139-a878-088953999daa-secret-metrics-server-client-certs\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.740698 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.740678 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mfl4\" (UniqueName: \"kubernetes.io/projected/eaf84110-9953-4139-a878-088953999daa-kube-api-access-6mfl4\") pod \"metrics-server-7b4c77b7bf-rzkmr\" (UID: \"eaf84110-9953-4139-a878-088953999daa\") " pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.870125 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.870091 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:14.875694 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.875664 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk"] Jul 28 14:57:14.879368 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.879343 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:14.881298 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.881274 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 14:57:14.881679 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.881659 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rxd2t\"" Jul 28 14:57:14.885952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.885525 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk"] Jul 28 14:57:14.935835 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.935381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cbvv\" (UniqueName: \"kubernetes.io/projected/eaafcef7-72ca-4540-9048-ab205ab99523-kube-api-access-5cbvv\") pod \"monitoring-plugin-68b7fc9574-l8ndk\" (UID: \"eaafcef7-72ca-4540-9048-ab205ab99523\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:14.935835 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:14.935524 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaafcef7-72ca-4540-9048-ab205ab99523-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-l8ndk\" (UID: \"eaafcef7-72ca-4540-9048-ab205ab99523\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:15.028985 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.028951 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr"] Jul 28 14:57:15.031761 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:57:15.031732 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf84110_9953_4139_a878_088953999daa.slice/crio-b523b257804bb253046dce8b383f61c4ade95c578ffef021dbd377b72d47adaf WatchSource:0}: Error finding container b523b257804bb253046dce8b383f61c4ade95c578ffef021dbd377b72d47adaf: Status 404 returned error can't find the container with id b523b257804bb253046dce8b383f61c4ade95c578ffef021dbd377b72d47adaf Jul 28 14:57:15.036371 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.036347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cbvv\" (UniqueName: \"kubernetes.io/projected/eaafcef7-72ca-4540-9048-ab205ab99523-kube-api-access-5cbvv\") pod \"monitoring-plugin-68b7fc9574-l8ndk\" (UID: \"eaafcef7-72ca-4540-9048-ab205ab99523\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:15.036474 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.036395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaafcef7-72ca-4540-9048-ab205ab99523-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-l8ndk\" (UID: \"eaafcef7-72ca-4540-9048-ab205ab99523\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:15.036552 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:57:15.036518 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 28 14:57:15.036606 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:57:15.036579 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaafcef7-72ca-4540-9048-ab205ab99523-monitoring-plugin-cert podName:eaafcef7-72ca-4540-9048-ab205ab99523 nodeName:}" failed. No retries permitted until 2026-07-28 14:57:15.536559797 +0000 UTC m=+116.780498826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/eaafcef7-72ca-4540-9048-ab205ab99523-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-l8ndk" (UID: "eaafcef7-72ca-4540-9048-ab205ab99523") : secret "monitoring-plugin-cert" not found Jul 28 14:57:15.044642 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.044581 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cbvv\" (UniqueName: \"kubernetes.io/projected/eaafcef7-72ca-4540-9048-ab205ab99523-kube-api-access-5cbvv\") pod \"monitoring-plugin-68b7fc9574-l8ndk\" (UID: \"eaafcef7-72ca-4540-9048-ab205ab99523\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:15.075606 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.075574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nvmct" event={"ID":"65ef832d-c07f-44c0-ac5e-974c77ed07de","Type":"ContainerStarted","Data":"afd755bf913a319fa409bd865d9e8a19e1bbce6987cae6103815c0a2db5436e6"} Jul 28 14:57:15.077510 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.077484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" event={"ID":"eaf84110-9953-4139-a878-088953999daa","Type":"ContainerStarted","Data":"b523b257804bb253046dce8b383f61c4ade95c578ffef021dbd377b72d47adaf"} Jul 28 14:57:15.080127 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.080100 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gblh7" event={"ID":"611b91b1-374b-4942-8cf2-e030d66f210a","Type":"ContainerStarted","Data":"d7ea9a5604905a997dd9d3e511e1837368d3279a1894bf7332bee02fa2713389"} Jul 28 14:57:15.080232 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.080183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gblh7" event={"ID":"611b91b1-374b-4942-8cf2-e030d66f210a","Type":"ContainerStarted","Data":"eaa9b48cbfac39d9dba884387645579d0fe9d37d8896646d9f4a76fa633b93e3"} Jul 28 14:57:15.098150 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.098100 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nvmct" podStartSLOduration=33.493977442 podStartE2EDuration="50.09808418s" totalImagesPullingTime="16.604106738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:56:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:15.097288604 +0000 UTC m=+116.341227653" watchObservedRunningTime="2026-07-28 14:57:15.09808418 +0000 UTC m=+116.342023203" Jul 28 14:57:15.117379 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.116964 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gblh7" podStartSLOduration=3.744661781 podStartE2EDuration="5.116940822s" totalImagesPullingTime="1.292379361s" totalInitContainerRuntime="79.89968ms" isStatefulPod=true podCreationTimestamp="2026-07-28 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:15.115400727 +0000 UTC m=+116.359339776" watchObservedRunningTime="2026-07-28 14:57:15.116940822 +0000 UTC m=+116.360879867" Jul 28 14:57:15.541918 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.541871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaafcef7-72ca-4540-9048-ab205ab99523-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-l8ndk\" (UID: \"eaafcef7-72ca-4540-9048-ab205ab99523\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:15.544964 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.544936 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eaafcef7-72ca-4540-9048-ab205ab99523-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-l8ndk\" (UID: \"eaafcef7-72ca-4540-9048-ab205ab99523\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:15.802344 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:15.802260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:16.307306 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.307259 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:57:16.313757 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.313729 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.316094 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.316003 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 14:57:16.316094 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.316090 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 14:57:16.316280 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.316100 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e80b5tivs2pk4\"" Jul 28 14:57:16.316280 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.316114 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 14:57:16.316280 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.316005 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 14:57:16.316717 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.316691 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 14:57:16.316825 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.316740 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 14:57:16.317324 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.317300 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 14:57:16.317595 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.317572 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 14:57:16.318543 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.318416 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 14:57:16.318543 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.318519 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bl45t\"" Jul 28 14:57:16.321096 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.318573 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 14:57:16.321096 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.318743 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 14:57:16.321096 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.318863 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 14:57:16.321997 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.321976 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 14:57:16.324984 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.324772 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 14:57:16.325342 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.325312 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:57:16.452833 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.452800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453023 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.452846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453023 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.452873 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453023 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.452922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453023 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.452961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453023 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.452987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453023 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clkqz\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-kube-api-access-clkqz\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453271 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453271 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453271 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453174 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453271 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453271 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453250 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453478 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453478 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453478 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453478 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453478 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453677 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453677 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.453677 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.453551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554538 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554989 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554989 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554989 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554989 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554989 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554989 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554989 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.554989 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.554984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555019 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clkqz\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-kube-api-access-clkqz\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555147 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555178 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555255 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555325 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555377 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555949 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555376 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.555949 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.555715 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.556233 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.556204 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.558540 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.558185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-web-config\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.559080 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.558962 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.559821 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.559515 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.559821 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.559720 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.560353 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.560328 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.560969 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.560905 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.561831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.561741 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.561831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.561792 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.562216 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.562154 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config-out\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.562744 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.562549 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.562744 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.562559 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.562894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.562766 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.563162 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.563142 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.564044 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.564020 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.564654 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.564622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clkqz\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-kube-api-access-clkqz\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.564902 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.564884 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.629262 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.629233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:16.777187 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.777060 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk"] Jul 28 14:57:16.782594 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:57:16.782559 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaafcef7_72ca_4540_9048_ab205ab99523.slice/crio-78f79b248fcdad069f94249c8855d7b427f8188898d418d1095acf878437a2fb WatchSource:0}: Error finding container 78f79b248fcdad069f94249c8855d7b427f8188898d418d1095acf878437a2fb: Status 404 returned error can't find the container with id 78f79b248fcdad069f94249c8855d7b427f8188898d418d1095acf878437a2fb Jul 28 14:57:16.829722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:16.829697 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:57:16.833824 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:57:16.833793 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a2a91b_a448_4dfc_b2d1_e521c35649ea.slice/crio-62bff2d584b5c9a9c8bac74573370075144c1fd5af9e342bd3cee09e62c8ce2b WatchSource:0}: Error finding container 62bff2d584b5c9a9c8bac74573370075144c1fd5af9e342bd3cee09e62c8ce2b: Status 404 returned error can't find the container with id 62bff2d584b5c9a9c8bac74573370075144c1fd5af9e342bd3cee09e62c8ce2b Jul 28 14:57:17.026768 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:17.026740 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cqjcd" Jul 28 14:57:17.093832 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:17.093744 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9466c66-cq659" event={"ID":"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888","Type":"ContainerStarted","Data":"684790b139dd1ec656381ad9a0a36583452b179b2728ad74776af0dc27f00d45"} Jul 28 14:57:17.093984 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:17.093837 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9466c66-cq659" event={"ID":"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888","Type":"ContainerStarted","Data":"9b73efb47f28b466cd9580f8cc4ee58a4599ed5acb0eba9b8680d4a91b439259"} Jul 28 14:57:17.093984 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:17.093882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9466c66-cq659" event={"ID":"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888","Type":"ContainerStarted","Data":"f5721efd984f24d5194a5f0392bcb608dfb334f4bacab32d77c63c016b180eb4"} Jul 28 14:57:17.095541 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:17.095499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" event={"ID":"eaf84110-9953-4139-a878-088953999daa","Type":"ContainerStarted","Data":"44a0dbd5f063ce7631ea3b7fc4a1e4865f33a08b0fef767efebee4218bb33c39"} Jul 28 14:57:17.096804 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:17.096782 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerStarted","Data":"62bff2d584b5c9a9c8bac74573370075144c1fd5af9e342bd3cee09e62c8ce2b"} Jul 28 14:57:17.098080 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:17.098054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" event={"ID":"eaafcef7-72ca-4540-9048-ab205ab99523","Type":"ContainerStarted","Data":"78f79b248fcdad069f94249c8855d7b427f8188898d418d1095acf878437a2fb"} Jul 28 14:57:17.113495 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:17.113420 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" podStartSLOduration=1.553141648 podStartE2EDuration="3.113402658s" totalImagesPullingTime="1.56026101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:17.112636258 +0000 UTC m=+118.356575301" watchObservedRunningTime="2026-07-28 14:57:17.113402658 +0000 UTC m=+118.357341703" Jul 28 14:57:18.603279 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:18.603098 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:57:18.607152 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:18.607129 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:57:19.109743 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.109707 2561 generic.go:356] "Generic (PLEG): container finished" podID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" exitCode=0 Jul 28 14:57:19.109950 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.109802 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerDied","Data":"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99"} Jul 28 14:57:19.111592 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.111476 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" event={"ID":"eaafcef7-72ca-4540-9048-ab205ab99523","Type":"ContainerStarted","Data":"45ea572231d96ed797370a469e7a20a5ea05608c8ecba7c4b62e3686eb07a1cc"} Jul 28 14:57:19.111656 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.111620 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:19.114852 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.114831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9466c66-cq659" event={"ID":"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888","Type":"ContainerStarted","Data":"66bea138a4506d2159da36974a929bb3090044bee5b516effcff21c60f8ff9de"} Jul 28 14:57:19.114936 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.114896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9466c66-cq659" event={"ID":"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888","Type":"ContainerStarted","Data":"cd28864480f5c2505a867df8401dbf711620fb91f13a3a789654b2c4205944ad"} Jul 28 14:57:19.115019 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.114941 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-9466c66-cq659" event={"ID":"6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888","Type":"ContainerStarted","Data":"ebabeecee5eb9305b3dc6ed1bb49c7668393e1b22d0553a421256b6ab56214fb"} Jul 28 14:57:19.117569 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.117548 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" Jul 28 14:57:19.160802 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.160755 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-9466c66-cq659" podStartSLOduration=1.728697866 podStartE2EDuration="7.160738857s" totalImagesPullingTime="5.432040991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:57:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:19.159541997 +0000 UTC m=+120.403481043" watchObservedRunningTime="2026-07-28 14:57:19.160738857 +0000 UTC m=+120.404677910" Jul 28 14:57:19.174926 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.174872 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-l8ndk" podStartSLOduration=3.661180008 podStartE2EDuration="5.174852744s" totalImagesPullingTime="1.513672736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:19.173746832 +0000 UTC m=+120.417685878" watchObservedRunningTime="2026-07-28 14:57:19.174852744 +0000 UTC m=+120.418791789" Jul 28 14:57:19.271252 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.271211 2561 patch_prober.go:28] interesting pod/image-registry-df89c7686-jdjq8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 14:57:19.271471 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:19.271269 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" podUID="ec32d959-770c-4665-90ce-da9329d42669" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 14:57:20.120141 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:20.120106 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:21.132004 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:21.131961 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-9466c66-cq659" Jul 28 14:57:21.998798 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:21.998772 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:57:22.135434 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:22.135136 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerStarted","Data":"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847"} Jul 28 14:57:22.135434 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:22.135229 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerStarted","Data":"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c"} Jul 28 14:57:22.135434 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:22.135268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerStarted","Data":"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98"} Jul 28 14:57:23.143858 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:23.143827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerStarted","Data":"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d"} Jul 28 14:57:23.144230 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:23.143889 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerStarted","Data":"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8"} Jul 28 14:57:23.144230 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:23.143921 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerStarted","Data":"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8"} Jul 28 14:57:23.173304 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:23.173233 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.933974578 podStartE2EDuration="7.173209436s" totalImagesPullingTime="4.210792397s" totalInitContainerRuntime="28.442461ms" isStatefulPod=false podCreationTimestamp="2026-07-28 14:57:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:23.170603589 +0000 UTC m=+124.414542648" watchObservedRunningTime="2026-07-28 14:57:23.173209436 +0000 UTC m=+124.417148482" Jul 28 14:57:25.478654 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:25.478621 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df89c7686-jdjq8"] Jul 28 14:57:26.629619 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:26.629576 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:57:26.663697 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:26.663663 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfb7f964b-b9p8r"] Jul 28 14:57:29.182918 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:29.182882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:57:29.185243 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:29.185216 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4296243-f2f2-41db-b931-eb6e89110195-metrics-certs\") pod \"network-metrics-daemon-246q4\" (UID: \"a4296243-f2f2-41db-b931-eb6e89110195\") " pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:57:29.479599 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:29.479523 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2w55\"" Jul 28 14:57:29.487406 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:29.487382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-246q4" Jul 28 14:57:29.624880 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:29.624855 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-246q4"] Jul 28 14:57:29.629555 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:57:29.629489 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4296243_f2f2_41db_b931_eb6e89110195.slice/crio-a90d232ff28fbda3dfb1247855d66c3898bf74276945933c53174f83be7c7c70 WatchSource:0}: Error finding container a90d232ff28fbda3dfb1247855d66c3898bf74276945933c53174f83be7c7c70: Status 404 returned error can't find the container with id a90d232ff28fbda3dfb1247855d66c3898bf74276945933c53174f83be7c7c70 Jul 28 14:57:30.174489 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:30.174429 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-246q4" event={"ID":"a4296243-f2f2-41db-b931-eb6e89110195","Type":"ContainerStarted","Data":"a90d232ff28fbda3dfb1247855d66c3898bf74276945933c53174f83be7c7c70"} Jul 28 14:57:31.184668 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:31.184624 2561 generic.go:356] "Generic (PLEG): container finished" podID="15a72792-c48e-4843-a853-888cba7646a3" containerID="dd58dadf633bd93113f5522307e66d494d489d51553fa86939c630145860cb58" exitCode=0 Jul 28 14:57:31.185172 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:31.184697 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" event={"ID":"15a72792-c48e-4843-a853-888cba7646a3","Type":"ContainerDied","Data":"dd58dadf633bd93113f5522307e66d494d489d51553fa86939c630145860cb58"} Jul 28 14:57:31.185172 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:31.185086 2561 scope.go:117] "RemoveContainer" containerID="dd58dadf633bd93113f5522307e66d494d489d51553fa86939c630145860cb58" Jul 28 14:57:31.186862 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:31.186835 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-246q4" event={"ID":"a4296243-f2f2-41db-b931-eb6e89110195","Type":"ContainerStarted","Data":"548e4ffdac436d8079c0bc001091c4b1357efc1f6468ea2fb3f13062573455aa"} Jul 28 14:57:31.186862 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:31.186891 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-246q4" event={"ID":"a4296243-f2f2-41db-b931-eb6e89110195","Type":"ContainerStarted","Data":"c694a872f7c9609840fce28066db3535160ddba977f6de728600a4bc010b11b3"} Jul 28 14:57:31.216162 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:31.216115 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-246q4" podStartSLOduration=131.357588691 podStartE2EDuration="2m12.216099301s" totalImagesPullingTime="858.51061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:57:31.215630935 +0000 UTC m=+132.459569981" watchObservedRunningTime="2026-07-28 14:57:31.216099301 +0000 UTC m=+132.460038346" Jul 28 14:57:32.192346 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:32.192312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn" event={"ID":"15a72792-c48e-4843-a853-888cba7646a3","Type":"ContainerStarted","Data":"16761b0afccd87c307587171eddf8269c57f171d26270145a6aa600eb99eaff9"} Jul 28 14:57:34.870719 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:34.870671 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:34.871113 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:34.870747 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:50.270701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.270624 2561 generic.go:356] "Generic (PLEG): container finished" podID="2dd74425-afae-4808-a442-c4ec82f416d9" containerID="0b310b905445508e2b54c3cf19c04b821c1949e2f4fce1c5c7635fc97c5be1fe" exitCode=0 Jul 28 14:57:50.270701 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.270684 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-569lv" event={"ID":"2dd74425-afae-4808-a442-c4ec82f416d9","Type":"ContainerDied","Data":"0b310b905445508e2b54c3cf19c04b821c1949e2f4fce1c5c7635fc97c5be1fe"} Jul 28 14:57:50.271094 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.271005 2561 scope.go:117] "RemoveContainer" containerID="0b310b905445508e2b54c3cf19c04b821c1949e2f4fce1c5c7635fc97c5be1fe" Jul 28 14:57:50.503596 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.503559 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" podUID="ec32d959-770c-4665-90ce-da9329d42669" containerName="registry" containerID="cri-o://47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8" gracePeriod=30 Jul 28 14:57:50.794685 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.794625 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:57:50.862404 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.862372 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") pod \"ec32d959-770c-4665-90ce-da9329d42669\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " Jul 28 14:57:50.862404 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.862409 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-image-registry-private-configuration\") pod \"ec32d959-770c-4665-90ce-da9329d42669\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " Jul 28 14:57:50.862658 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.862490 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-installation-pull-secrets\") pod \"ec32d959-770c-4665-90ce-da9329d42669\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " Jul 28 14:57:50.862658 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.862536 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-bound-sa-token\") pod \"ec32d959-770c-4665-90ce-da9329d42669\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " Jul 28 14:57:50.862658 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.862554 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec32d959-770c-4665-90ce-da9329d42669-ca-trust-extracted\") pod \"ec32d959-770c-4665-90ce-da9329d42669\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " Jul 28 14:57:50.862658 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.862617 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-trusted-ca\") pod \"ec32d959-770c-4665-90ce-da9329d42669\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " Jul 28 14:57:50.862658 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.862645 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-registry-certificates\") pod \"ec32d959-770c-4665-90ce-da9329d42669\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " Jul 28 14:57:50.862914 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.862691 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnxsc\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-kube-api-access-pnxsc\") pod \"ec32d959-770c-4665-90ce-da9329d42669\" (UID: \"ec32d959-770c-4665-90ce-da9329d42669\") " Jul 28 14:57:50.863140 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.863108 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ec32d959-770c-4665-90ce-da9329d42669" (UID: "ec32d959-770c-4665-90ce-da9329d42669"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:57:50.863220 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.863177 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ec32d959-770c-4665-90ce-da9329d42669" (UID: "ec32d959-770c-4665-90ce-da9329d42669"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:57:50.864768 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.864742 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ec32d959-770c-4665-90ce-da9329d42669" (UID: "ec32d959-770c-4665-90ce-da9329d42669"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:57:50.865081 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.865049 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-kube-api-access-pnxsc" (OuterVolumeSpecName: "kube-api-access-pnxsc") pod "ec32d959-770c-4665-90ce-da9329d42669" (UID: "ec32d959-770c-4665-90ce-da9329d42669"). InnerVolumeSpecName "kube-api-access-pnxsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:57:50.865081 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.865062 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ec32d959-770c-4665-90ce-da9329d42669" (UID: "ec32d959-770c-4665-90ce-da9329d42669"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:57:50.865220 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.865200 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ec32d959-770c-4665-90ce-da9329d42669" (UID: "ec32d959-770c-4665-90ce-da9329d42669"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:57:50.865391 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.865376 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ec32d959-770c-4665-90ce-da9329d42669" (UID: "ec32d959-770c-4665-90ce-da9329d42669"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:57:50.871012 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.870985 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec32d959-770c-4665-90ce-da9329d42669-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ec32d959-770c-4665-90ce-da9329d42669" (UID: "ec32d959-770c-4665-90ce-da9329d42669"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:57:50.963746 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.963708 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-trusted-ca\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:50.963746 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.963738 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ec32d959-770c-4665-90ce-da9329d42669-registry-certificates\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:50.963746 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.963749 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnxsc\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-kube-api-access-pnxsc\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:50.963962 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.963759 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-registry-tls\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:50.963962 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.963769 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-image-registry-private-configuration\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:50.963962 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.963778 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ec32d959-770c-4665-90ce-da9329d42669-installation-pull-secrets\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:50.963962 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.963786 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ec32d959-770c-4665-90ce-da9329d42669-bound-sa-token\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:50.963962 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:50.963794 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ec32d959-770c-4665-90ce-da9329d42669-ca-trust-extracted\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:51.276413 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.276380 2561 generic.go:356] "Generic (PLEG): container finished" podID="ec32d959-770c-4665-90ce-da9329d42669" containerID="47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8" exitCode=0 Jul 28 14:57:51.276910 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.276423 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" Jul 28 14:57:51.276910 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.276471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" event={"ID":"ec32d959-770c-4665-90ce-da9329d42669","Type":"ContainerDied","Data":"47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8"} Jul 28 14:57:51.276910 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.276527 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df89c7686-jdjq8" event={"ID":"ec32d959-770c-4665-90ce-da9329d42669","Type":"ContainerDied","Data":"be2786e47d33e96c7e9ade3f511a65d8b9338b84458c6145c3b9b226ec2ac925"} Jul 28 14:57:51.276910 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.276553 2561 scope.go:117] "RemoveContainer" containerID="47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8" Jul 28 14:57:51.278831 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.278806 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-569lv" event={"ID":"2dd74425-afae-4808-a442-c4ec82f416d9","Type":"ContainerStarted","Data":"4c28b251eb29cdd3a53fbd005d71543319fcf810ea039471c834db64dc894ad2"} Jul 28 14:57:51.293579 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.293560 2561 scope.go:117] "RemoveContainer" containerID="47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8" Jul 28 14:57:51.293815 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:57:51.293797 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8\": container with ID starting with 47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8 not found: ID does not exist" containerID="47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8" Jul 28 14:57:51.293871 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.293824 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8"} err="failed to get container status \"47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8\": rpc error: code = NotFound desc = could not find container \"47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8\": container with ID starting with 47e6b2c759ad81962eb6405fed2d0dd2175d4dacef7ff1ffaf7f0512c98104e8 not found: ID does not exist" Jul 28 14:57:51.310403 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.310379 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df89c7686-jdjq8"] Jul 28 14:57:51.316530 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.316504 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-df89c7686-jdjq8"] Jul 28 14:57:51.470795 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.470761 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec32d959-770c-4665-90ce-da9329d42669" path="/var/lib/kubelet/pods/ec32d959-770c-4665-90ce-da9329d42669/volumes" Jul 28 14:57:51.683500 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.683431 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bfb7f964b-b9p8r" podUID="a5355820-1193-4e8c-87b3-b4acf2ef30ac" containerName="console" containerID="cri-o://9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de" gracePeriod=15 Jul 28 14:57:51.965650 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:51.965624 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:57:52.072215 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072135 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-config\") pod \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " Jul 28 14:57:52.072215 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072184 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-oauth-config\") pod \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " Jul 28 14:57:52.072433 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072212 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-trusted-ca-bundle\") pod \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " Jul 28 14:57:52.072433 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072378 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdbnq\" (UniqueName: \"kubernetes.io/projected/a5355820-1193-4e8c-87b3-b4acf2ef30ac-kube-api-access-sdbnq\") pod \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " Jul 28 14:57:52.072565 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072494 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-service-ca\") pod \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " Jul 28 14:57:52.072565 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072514 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-serving-cert\") pod \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " Jul 28 14:57:52.072565 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072535 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-oauth-serving-cert\") pod \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\" (UID: \"a5355820-1193-4e8c-87b3-b4acf2ef30ac\") " Jul 28 14:57:52.072695 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072556 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-config" (OuterVolumeSpecName: "console-config") pod "a5355820-1193-4e8c-87b3-b4acf2ef30ac" (UID: "a5355820-1193-4e8c-87b3-b4acf2ef30ac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:57:52.072695 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072577 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a5355820-1193-4e8c-87b3-b4acf2ef30ac" (UID: "a5355820-1193-4e8c-87b3-b4acf2ef30ac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:57:52.072804 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072784 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-config\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:52.072854 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072812 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-trusted-ca-bundle\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:52.072902 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.072848 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-service-ca" (OuterVolumeSpecName: "service-ca") pod "a5355820-1193-4e8c-87b3-b4acf2ef30ac" (UID: "a5355820-1193-4e8c-87b3-b4acf2ef30ac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:57:52.073018 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.073001 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a5355820-1193-4e8c-87b3-b4acf2ef30ac" (UID: "a5355820-1193-4e8c-87b3-b4acf2ef30ac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:57:52.074566 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.074539 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a5355820-1193-4e8c-87b3-b4acf2ef30ac" (UID: "a5355820-1193-4e8c-87b3-b4acf2ef30ac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:57:52.074659 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.074604 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a5355820-1193-4e8c-87b3-b4acf2ef30ac" (UID: "a5355820-1193-4e8c-87b3-b4acf2ef30ac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:57:52.074659 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.074606 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5355820-1193-4e8c-87b3-b4acf2ef30ac-kube-api-access-sdbnq" (OuterVolumeSpecName: "kube-api-access-sdbnq") pod "a5355820-1193-4e8c-87b3-b4acf2ef30ac" (UID: "a5355820-1193-4e8c-87b3-b4acf2ef30ac"). InnerVolumeSpecName "kube-api-access-sdbnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:57:52.173902 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.173866 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-service-ca\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:52.173902 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.173899 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-serving-cert\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:52.174103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.173912 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a5355820-1193-4e8c-87b3-b4acf2ef30ac-oauth-serving-cert\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:52.174103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.173926 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a5355820-1193-4e8c-87b3-b4acf2ef30ac-console-oauth-config\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:52.174103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.173938 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdbnq\" (UniqueName: \"kubernetes.io/projected/a5355820-1193-4e8c-87b3-b4acf2ef30ac-kube-api-access-sdbnq\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:57:52.285963 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.285923 2561 generic.go:356] "Generic (PLEG): container finished" podID="a5355820-1193-4e8c-87b3-b4acf2ef30ac" containerID="9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de" exitCode=0 Jul 28 14:57:52.285963 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.285962 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfb7f964b-b9p8r" Jul 28 14:57:52.286430 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.286009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfb7f964b-b9p8r" event={"ID":"a5355820-1193-4e8c-87b3-b4acf2ef30ac","Type":"ContainerDied","Data":"9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de"} Jul 28 14:57:52.286430 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.286059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfb7f964b-b9p8r" event={"ID":"a5355820-1193-4e8c-87b3-b4acf2ef30ac","Type":"ContainerDied","Data":"95345059ea0c273538a3fbd2bbaa9379afdb91bc3c972d97d2ebaef8214d58d5"} Jul 28 14:57:52.286430 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.286093 2561 scope.go:117] "RemoveContainer" containerID="9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de" Jul 28 14:57:52.295298 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.295281 2561 scope.go:117] "RemoveContainer" containerID="9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de" Jul 28 14:57:52.295577 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:57:52.295561 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de\": container with ID starting with 9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de not found: ID does not exist" containerID="9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de" Jul 28 14:57:52.295629 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.295586 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de"} err="failed to get container status \"9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de\": rpc error: code = NotFound desc = could not find container \"9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de\": container with ID starting with 9c6f6ef29453ab9286681a086ff44646137b690afd4472bae346123e64f988de not found: ID does not exist" Jul 28 14:57:52.310029 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.310006 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfb7f964b-b9p8r"] Jul 28 14:57:52.312535 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:52.312509 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bfb7f964b-b9p8r"] Jul 28 14:57:53.470906 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:53.470873 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5355820-1193-4e8c-87b3-b4acf2ef30ac" path="/var/lib/kubelet/pods/a5355820-1193-4e8c-87b3-b4acf2ef30ac/volumes" Jul 28 14:57:54.876360 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:54.876320 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:57:54.880111 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:57:54.880078 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b4c77b7bf-rzkmr" Jul 28 14:58:16.630347 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:16.630253 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:16.645993 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:16.645966 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:17.408783 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:17.408747 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:34.720329 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:34.720290 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:58:34.720920 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:34.720628 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="prometheus" containerID="cri-o://71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" gracePeriod=600 Jul 28 14:58:34.720920 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:34.720740 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="config-reloader" containerID="cri-o://2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" gracePeriod=600 Jul 28 14:58:34.720920 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:34.720646 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy" containerID="cri-o://9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" gracePeriod=600 Jul 28 14:58:34.720920 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:34.720677 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy-web" containerID="cri-o://0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" gracePeriod=600 Jul 28 14:58:34.720920 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:34.720691 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="thanos-sidecar" containerID="cri-o://2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" gracePeriod=600 Jul 28 14:58:34.720920 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:34.720692 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" gracePeriod=600 Jul 28 14:58:34.983535 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:34.983469 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.052906 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.052875 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-tls\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.052943 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-db\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.052966 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-grpc-tls\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.052995 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053021 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-web-config\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053103 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053048 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053578 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053503 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-kube-rbac-proxy\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053578 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053552 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-thanos-prometheus-http-client-file\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053750 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053584 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-metrics-client-certs\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053750 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053607 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053750 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053660 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-1\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053750 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053689 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-0\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053750 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053715 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-serving-certs-ca-bundle\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053993 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053748 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clkqz\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-kube-api-access-clkqz\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053993 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053786 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config-out\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053993 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053834 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-metrics-client-ca\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053993 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053875 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-tls-assets\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053993 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053900 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-kubelet-serving-ca-bundle\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053993 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053928 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-2\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.053993 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.053984 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-trusted-ca-bundle\") pod \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\" (UID: \"73a2a91b-a448-4dfc-b2d1-e521c35649ea\") " Jul 28 14:58:35.054309 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.054173 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:58:35.054309 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.054290 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-db\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.054867 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.054574 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:58:35.054867 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.054583 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:58:35.055882 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.055856 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:58:35.056715 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.056686 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:58:35.056818 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.056798 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:58:35.056888 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.056841 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.057049 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.057017 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.057162 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.057125 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:58:35.057629 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.057599 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.058362 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.058335 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 14:58:35.058746 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.058709 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-kube-api-access-clkqz" (OuterVolumeSpecName: "kube-api-access-clkqz") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "kube-api-access-clkqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:58:35.058960 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.058880 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.058960 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.058907 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 14:58:35.059131 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.058957 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.059131 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.059011 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.059131 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.059026 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.059575 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.059545 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config-out" (OuterVolumeSpecName: "config-out") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 14:58:35.060231 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.060204 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config" (OuterVolumeSpecName: "config") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.069330 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.069303 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-web-config" (OuterVolumeSpecName: "web-config") pod "73a2a91b-a448-4dfc-b2d1-e521c35649ea" (UID: "73a2a91b-a448-4dfc-b2d1-e521c35649ea"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 14:58:35.155166 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155135 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-tls-assets\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155166 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155160 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155166 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155172 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155181 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155193 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155201 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-grpc-tls\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155210 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155218 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-web-config\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155226 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155234 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-kube-rbac-proxy\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155243 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155251 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-secret-metrics-client-certs\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155259 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155266 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155276 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155284 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155292 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clkqz\" (UniqueName: \"kubernetes.io/projected/73a2a91b-a448-4dfc-b2d1-e521c35649ea-kube-api-access-clkqz\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155300 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73a2a91b-a448-4dfc-b2d1-e521c35649ea-config-out\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.155387 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.155309 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73a2a91b-a448-4dfc-b2d1-e521c35649ea-configmap-metrics-client-ca\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 14:58:35.465332 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.465299 2561 generic.go:356] "Generic (PLEG): container finished" podID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" exitCode=0 Jul 28 14:58:35.465332 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.465325 2561 generic.go:356] "Generic (PLEG): container finished" podID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" exitCode=0 Jul 28 14:58:35.465332 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.465333 2561 generic.go:356] "Generic (PLEG): container finished" podID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" exitCode=0 Jul 28 14:58:35.465332 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.465339 2561 generic.go:356] "Generic (PLEG): container finished" podID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" exitCode=0 Jul 28 14:58:35.465710 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.465345 2561 generic.go:356] "Generic (PLEG): container finished" podID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" exitCode=0 Jul 28 14:58:35.465710 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.465351 2561 generic.go:356] "Generic (PLEG): container finished" podID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" exitCode=0 Jul 28 14:58:35.465710 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.465477 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.470414 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.470383 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerDied","Data":"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d"} Jul 28 14:58:35.470592 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.470455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerDied","Data":"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8"} Jul 28 14:58:35.470592 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.470506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerDied","Data":"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8"} Jul 28 14:58:35.470592 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.470553 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerDied","Data":"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847"} Jul 28 14:58:35.470592 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.470593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerDied","Data":"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c"} Jul 28 14:58:35.470819 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.470635 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerDied","Data":"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98"} Jul 28 14:58:35.470819 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.470676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73a2a91b-a448-4dfc-b2d1-e521c35649ea","Type":"ContainerDied","Data":"62bff2d584b5c9a9c8bac74573370075144c1fd5af9e342bd3cee09e62c8ce2b"} Jul 28 14:58:35.470819 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.470680 2561 scope.go:117] "RemoveContainer" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" Jul 28 14:58:35.479256 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.479229 2561 scope.go:117] "RemoveContainer" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" Jul 28 14:58:35.487519 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.487503 2561 scope.go:117] "RemoveContainer" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" Jul 28 14:58:35.494361 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.494332 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:58:35.499880 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.499853 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:58:35.503196 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.503172 2561 scope.go:117] "RemoveContainer" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" Jul 28 14:58:35.509973 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.509957 2561 scope.go:117] "RemoveContainer" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" Jul 28 14:58:35.517954 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.517928 2561 scope.go:117] "RemoveContainer" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" Jul 28 14:58:35.524323 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524301 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:58:35.524646 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524631 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524647 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524660 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="config-reloader" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524666 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="config-reloader" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524676 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="init-config-reloader" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524682 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="init-config-reloader" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524690 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy-web" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524695 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy-web" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524706 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="thanos-sidecar" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524711 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="thanos-sidecar" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524720 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy-thanos" Jul 28 14:58:35.524722 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524726 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy-thanos" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524735 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec32d959-770c-4665-90ce-da9329d42669" containerName="registry" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524740 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec32d959-770c-4665-90ce-da9329d42669" containerName="registry" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524746 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="prometheus" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524751 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="prometheus" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524759 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5355820-1193-4e8c-87b3-b4acf2ef30ac" containerName="console" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524763 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5355820-1193-4e8c-87b3-b4acf2ef30ac" containerName="console" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524810 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5355820-1193-4e8c-87b3-b4acf2ef30ac" containerName="console" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524817 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="config-reloader" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524822 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524827 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy-thanos" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524833 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="thanos-sidecar" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524839 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec32d959-770c-4665-90ce-da9329d42669" containerName="registry" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524844 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="prometheus" Jul 28 14:58:35.525038 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.524851 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" containerName="kube-rbac-proxy-web" Jul 28 14:58:35.526630 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.526610 2561 scope.go:117] "RemoveContainer" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" Jul 28 14:58:35.531660 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.531641 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.533723 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.533686 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 14:58:35.533723 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.533706 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 14:58:35.533956 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.533941 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 14:58:35.534119 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534102 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 14:58:35.534264 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534246 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 14:58:35.534388 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534370 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 14:58:35.534474 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534410 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 14:58:35.534557 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534472 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 14:58:35.534657 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534638 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e80b5tivs2pk4\"" Jul 28 14:58:35.534740 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534702 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 14:58:35.534740 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534702 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bl45t\"" Jul 28 14:58:35.534921 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534903 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 14:58:35.534921 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.534909 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 14:58:35.535591 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.535568 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 14:58:35.537311 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.537288 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 14:58:35.538329 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.538313 2561 scope.go:117] "RemoveContainer" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" Jul 28 14:58:35.538719 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:58:35.538671 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": container with ID starting with f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d not found: ID does not exist" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" Jul 28 14:58:35.538719 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.538729 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d"} err="failed to get container status \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": rpc error: code = NotFound desc = could not find container \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": container with ID starting with f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d not found: ID does not exist" Jul 28 14:58:35.538719 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.538755 2561 scope.go:117] "RemoveContainer" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" Jul 28 14:58:35.539096 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:58:35.539075 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": container with ID starting with 9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8 not found: ID does not exist" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" Jul 28 14:58:35.539146 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.539118 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8"} err="failed to get container status \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": rpc error: code = NotFound desc = could not find container \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": container with ID starting with 9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8 not found: ID does not exist" Jul 28 14:58:35.539186 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.539142 2561 scope.go:117] "RemoveContainer" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" Jul 28 14:58:35.539431 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:58:35.539413 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": container with ID starting with 0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8 not found: ID does not exist" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" Jul 28 14:58:35.539496 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.539436 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8"} err="failed to get container status \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": rpc error: code = NotFound desc = could not find container \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": container with ID starting with 0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8 not found: ID does not exist" Jul 28 14:58:35.539496 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.539474 2561 scope.go:117] "RemoveContainer" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" Jul 28 14:58:35.539885 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:58:35.539861 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": container with ID starting with 2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847 not found: ID does not exist" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" Jul 28 14:58:35.539924 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.539895 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847"} err="failed to get container status \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": rpc error: code = NotFound desc = could not find container \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": container with ID starting with 2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847 not found: ID does not exist" Jul 28 14:58:35.539959 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.539919 2561 scope.go:117] "RemoveContainer" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" Jul 28 14:58:35.540135 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:58:35.540110 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": container with ID starting with 2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c not found: ID does not exist" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" Jul 28 14:58:35.540332 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.540136 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c"} err="failed to get container status \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": rpc error: code = NotFound desc = could not find container \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": container with ID starting with 2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c not found: ID does not exist" Jul 28 14:58:35.540332 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.540154 2561 scope.go:117] "RemoveContainer" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" Jul 28 14:58:35.540582 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:58:35.540558 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": container with ID starting with 71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98 not found: ID does not exist" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" Jul 28 14:58:35.540679 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.540589 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98"} err="failed to get container status \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": rpc error: code = NotFound desc = could not find container \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": container with ID starting with 71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98 not found: ID does not exist" Jul 28 14:58:35.540679 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.540611 2561 scope.go:117] "RemoveContainer" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" Jul 28 14:58:35.540892 ip-10-0-129-173 kubenswrapper[2561]: E0728 14:58:35.540872 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": container with ID starting with 54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99 not found: ID does not exist" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" Jul 28 14:58:35.540956 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.540894 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99"} err="failed to get container status \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": rpc error: code = NotFound desc = could not find container \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": container with ID starting with 54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99 not found: ID does not exist" Jul 28 14:58:35.540956 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.540908 2561 scope.go:117] "RemoveContainer" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" Jul 28 14:58:35.541058 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.541038 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 14:58:35.541241 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.541214 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d"} err="failed to get container status \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": rpc error: code = NotFound desc = could not find container \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": container with ID starting with f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d not found: ID does not exist" Jul 28 14:58:35.541301 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.541245 2561 scope.go:117] "RemoveContainer" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" Jul 28 14:58:35.541524 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.541502 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8"} err="failed to get container status \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": rpc error: code = NotFound desc = could not find container \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": container with ID starting with 9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8 not found: ID does not exist" Jul 28 14:58:35.541573 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.541527 2561 scope.go:117] "RemoveContainer" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" Jul 28 14:58:35.541768 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.541747 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8"} err="failed to get container status \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": rpc error: code = NotFound desc = could not find container \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": container with ID starting with 0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8 not found: ID does not exist" Jul 28 14:58:35.541848 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.541770 2561 scope.go:117] "RemoveContainer" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" Jul 28 14:58:35.542013 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.541992 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847"} err="failed to get container status \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": rpc error: code = NotFound desc = could not find container \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": container with ID starting with 2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847 not found: ID does not exist" Jul 28 14:58:35.542052 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542016 2561 scope.go:117] "RemoveContainer" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" Jul 28 14:58:35.542233 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542215 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c"} err="failed to get container status \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": rpc error: code = NotFound desc = could not find container \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": container with ID starting with 2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c not found: ID does not exist" Jul 28 14:58:35.542303 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542235 2561 scope.go:117] "RemoveContainer" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" Jul 28 14:58:35.542462 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542430 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98"} err="failed to get container status \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": rpc error: code = NotFound desc = could not find container \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": container with ID starting with 71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98 not found: ID does not exist" Jul 28 14:58:35.542539 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542464 2561 scope.go:117] "RemoveContainer" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" Jul 28 14:58:35.542731 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542713 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99"} err="failed to get container status \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": rpc error: code = NotFound desc = could not find container \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": container with ID starting with 54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99 not found: ID does not exist" Jul 28 14:58:35.542779 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542732 2561 scope.go:117] "RemoveContainer" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" Jul 28 14:58:35.542976 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542957 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d"} err="failed to get container status \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": rpc error: code = NotFound desc = could not find container \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": container with ID starting with f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d not found: ID does not exist" Jul 28 14:58:35.543029 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.542976 2561 scope.go:117] "RemoveContainer" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" Jul 28 14:58:35.543219 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.543202 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8"} err="failed to get container status \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": rpc error: code = NotFound desc = could not find container \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": container with ID starting with 9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8 not found: ID does not exist" Jul 28 14:58:35.543273 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.543219 2561 scope.go:117] "RemoveContainer" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" Jul 28 14:58:35.543458 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.543429 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8"} err="failed to get container status \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": rpc error: code = NotFound desc = could not find container \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": container with ID starting with 0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8 not found: ID does not exist" Jul 28 14:58:35.543530 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.543466 2561 scope.go:117] "RemoveContainer" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" Jul 28 14:58:35.543735 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.543700 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847"} err="failed to get container status \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": rpc error: code = NotFound desc = could not find container \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": container with ID starting with 2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847 not found: ID does not exist" Jul 28 14:58:35.543735 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.543726 2561 scope.go:117] "RemoveContainer" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" Jul 28 14:58:35.544260 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.544238 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c"} err="failed to get container status \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": rpc error: code = NotFound desc = could not find container \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": container with ID starting with 2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c not found: ID does not exist" Jul 28 14:58:35.544358 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.544260 2561 scope.go:117] "RemoveContainer" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" Jul 28 14:58:35.544532 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.544512 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98"} err="failed to get container status \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": rpc error: code = NotFound desc = could not find container \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": container with ID starting with 71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98 not found: ID does not exist" Jul 28 14:58:35.544597 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.544534 2561 scope.go:117] "RemoveContainer" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" Jul 28 14:58:35.544788 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.544769 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99"} err="failed to get container status \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": rpc error: code = NotFound desc = could not find container \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": container with ID starting with 54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99 not found: ID does not exist" Jul 28 14:58:35.544894 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.544788 2561 scope.go:117] "RemoveContainer" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" Jul 28 14:58:35.545072 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.545048 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d"} err="failed to get container status \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": rpc error: code = NotFound desc = could not find container \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": container with ID starting with f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d not found: ID does not exist" Jul 28 14:58:35.545210 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.545189 2561 scope.go:117] "RemoveContainer" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" Jul 28 14:58:35.545499 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.545478 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8"} err="failed to get container status \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": rpc error: code = NotFound desc = could not find container \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": container with ID starting with 9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8 not found: ID does not exist" Jul 28 14:58:35.545499 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.545497 2561 scope.go:117] "RemoveContainer" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" Jul 28 14:58:35.545740 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.545722 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8"} err="failed to get container status \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": rpc error: code = NotFound desc = could not find container \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": container with ID starting with 0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8 not found: ID does not exist" Jul 28 14:58:35.545813 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.545742 2561 scope.go:117] "RemoveContainer" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" Jul 28 14:58:35.545981 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.545963 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847"} err="failed to get container status \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": rpc error: code = NotFound desc = could not find container \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": container with ID starting with 2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847 not found: ID does not exist" Jul 28 14:58:35.546049 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.545982 2561 scope.go:117] "RemoveContainer" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" Jul 28 14:58:35.546171 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546155 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:58:35.546225 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546199 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c"} err="failed to get container status \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": rpc error: code = NotFound desc = could not find container \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": container with ID starting with 2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c not found: ID does not exist" Jul 28 14:58:35.546225 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546218 2561 scope.go:117] "RemoveContainer" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" Jul 28 14:58:35.546457 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546426 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98"} err="failed to get container status \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": rpc error: code = NotFound desc = could not find container \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": container with ID starting with 71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98 not found: ID does not exist" Jul 28 14:58:35.546556 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546478 2561 scope.go:117] "RemoveContainer" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" Jul 28 14:58:35.546715 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546697 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99"} err="failed to get container status \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": rpc error: code = NotFound desc = could not find container \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": container with ID starting with 54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99 not found: ID does not exist" Jul 28 14:58:35.546758 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546714 2561 scope.go:117] "RemoveContainer" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" Jul 28 14:58:35.546932 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546903 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d"} err="failed to get container status \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": rpc error: code = NotFound desc = could not find container \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": container with ID starting with f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d not found: ID does not exist" Jul 28 14:58:35.546977 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.546934 2561 scope.go:117] "RemoveContainer" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" Jul 28 14:58:35.547153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.547138 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8"} err="failed to get container status \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": rpc error: code = NotFound desc = could not find container \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": container with ID starting with 9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8 not found: ID does not exist" Jul 28 14:58:35.547212 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.547153 2561 scope.go:117] "RemoveContainer" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" Jul 28 14:58:35.547440 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.547413 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8"} err="failed to get container status \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": rpc error: code = NotFound desc = could not find container \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": container with ID starting with 0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8 not found: ID does not exist" Jul 28 14:58:35.547564 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.547470 2561 scope.go:117] "RemoveContainer" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" Jul 28 14:58:35.547887 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.547754 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847"} err="failed to get container status \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": rpc error: code = NotFound desc = could not find container \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": container with ID starting with 2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847 not found: ID does not exist" Jul 28 14:58:35.547887 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.547779 2561 scope.go:117] "RemoveContainer" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" Jul 28 14:58:35.548050 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548022 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c"} err="failed to get container status \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": rpc error: code = NotFound desc = could not find container \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": container with ID starting with 2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c not found: ID does not exist" Jul 28 14:58:35.548151 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548050 2561 scope.go:117] "RemoveContainer" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" Jul 28 14:58:35.548293 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548272 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98"} err="failed to get container status \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": rpc error: code = NotFound desc = could not find container \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": container with ID starting with 71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98 not found: ID does not exist" Jul 28 14:58:35.548352 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548295 2561 scope.go:117] "RemoveContainer" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" Jul 28 14:58:35.548508 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548491 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99"} err="failed to get container status \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": rpc error: code = NotFound desc = could not find container \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": container with ID starting with 54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99 not found: ID does not exist" Jul 28 14:58:35.548571 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548509 2561 scope.go:117] "RemoveContainer" containerID="f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d" Jul 28 14:58:35.548716 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548696 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d"} err="failed to get container status \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": rpc error: code = NotFound desc = could not find container \"f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d\": container with ID starting with f216ffff46eea5098c10a72a285efacc8fe813d95f748b703359af8b6486c69d not found: ID does not exist" Jul 28 14:58:35.548716 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548711 2561 scope.go:117] "RemoveContainer" containerID="9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8" Jul 28 14:58:35.548971 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548941 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8"} err="failed to get container status \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": rpc error: code = NotFound desc = could not find container \"9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8\": container with ID starting with 9d52301dcddf24cb86e596108c0047b18bb4691e11cc0826d97e6507ce3e9bf8 not found: ID does not exist" Jul 28 14:58:35.548971 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.548966 2561 scope.go:117] "RemoveContainer" containerID="0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8" Jul 28 14:58:35.549270 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.549242 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8"} err="failed to get container status \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": rpc error: code = NotFound desc = could not find container \"0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8\": container with ID starting with 0746b523e9d30a1fe0a24258359ce45f5203bc897ecc1536c3b3c41d9a402fe8 not found: ID does not exist" Jul 28 14:58:35.549270 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.549267 2561 scope.go:117] "RemoveContainer" containerID="2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847" Jul 28 14:58:35.551506 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.549767 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847"} err="failed to get container status \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": rpc error: code = NotFound desc = could not find container \"2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847\": container with ID starting with 2adc5f359a9230bd9709a16f6c4484ee1eb6cf091109349dc0d73cf47a93a847 not found: ID does not exist" Jul 28 14:58:35.551590 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.551513 2561 scope.go:117] "RemoveContainer" containerID="2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c" Jul 28 14:58:35.551809 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.551790 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c"} err="failed to get container status \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": rpc error: code = NotFound desc = could not find container \"2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c\": container with ID starting with 2ad90ff5b256e274649af732fcb653d3e66a328003167228616956e0de279b5c not found: ID does not exist" Jul 28 14:58:35.551875 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.551810 2561 scope.go:117] "RemoveContainer" containerID="71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98" Jul 28 14:58:35.552057 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.552038 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98"} err="failed to get container status \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": rpc error: code = NotFound desc = could not find container \"71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98\": container with ID starting with 71f510d6d9c653bbd75a6ad934fa3eb6b1a461e013311528e0099248a88c8d98 not found: ID does not exist" Jul 28 14:58:35.552127 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.552059 2561 scope.go:117] "RemoveContainer" containerID="54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99" Jul 28 14:58:35.552300 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.552277 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99"} err="failed to get container status \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": rpc error: code = NotFound desc = could not find container \"54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99\": container with ID starting with 54512ebfa97495c22718a2c921bb7d71a9cd0c884ac75c30b7bb9a505f662f99 not found: ID does not exist" Jul 28 14:58:35.558742 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.558830 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.558830 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.558830 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558794 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.558939 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.558939 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559022 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559022 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-config\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559022 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.558975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559022 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559034 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559153 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559352 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559352 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559352 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559225 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4dwq\" (UniqueName: \"kubernetes.io/projected/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-kube-api-access-h4dwq\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559352 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.559352 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.559262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660126 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660126 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660275 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-config\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660381 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660431 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660573 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660655 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4dwq\" (UniqueName: \"kubernetes.io/projected/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-kube-api-access-h4dwq\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.660952 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.660884 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.661564 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.661535 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.661851 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.661825 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.662865 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.662510 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.663269 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.663001 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.663341 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.663301 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.664026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.663683 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.664026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.663877 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.664026 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.663910 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.664233 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.664053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.664294 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.664233 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.664373 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.664350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.664504 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.664477 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.664837 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.664812 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.665464 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.665426 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.665889 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.665868 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.666046 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.666028 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.666353 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.666333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.666490 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.666469 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-config\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.668807 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.668790 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4dwq\" (UniqueName: \"kubernetes.io/projected/31adf145-e6e8-4ff7-a8d9-9b8653598e7a-kube-api-access-h4dwq\") pod \"prometheus-k8s-0\" (UID: \"31adf145-e6e8-4ff7-a8d9-9b8653598e7a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.843272 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.843231 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:58:35.981758 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:35.981731 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 14:58:35.984365 ip-10-0-129-173 kubenswrapper[2561]: W0728 14:58:35.984341 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31adf145_e6e8_4ff7_a8d9_9b8653598e7a.slice/crio-3174d58ca2af8e39f1ef6005c0e6d7a7c9e29e639a9c3778ec1a46eb9ad4618e WatchSource:0}: Error finding container 3174d58ca2af8e39f1ef6005c0e6d7a7c9e29e639a9c3778ec1a46eb9ad4618e: Status 404 returned error can't find the container with id 3174d58ca2af8e39f1ef6005c0e6d7a7c9e29e639a9c3778ec1a46eb9ad4618e Jul 28 14:58:36.470930 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:36.470894 2561 generic.go:356] "Generic (PLEG): container finished" podID="31adf145-e6e8-4ff7-a8d9-9b8653598e7a" containerID="fb486c5b41fc3d03d3ed601b4d611dccde2c914761f8bc6e4c70ab16ae14cf9b" exitCode=0 Jul 28 14:58:36.471079 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:36.471027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31adf145-e6e8-4ff7-a8d9-9b8653598e7a","Type":"ContainerDied","Data":"fb486c5b41fc3d03d3ed601b4d611dccde2c914761f8bc6e4c70ab16ae14cf9b"} Jul 28 14:58:36.471139 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:36.471086 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31adf145-e6e8-4ff7-a8d9-9b8653598e7a","Type":"ContainerStarted","Data":"3174d58ca2af8e39f1ef6005c0e6d7a7c9e29e639a9c3778ec1a46eb9ad4618e"} Jul 28 14:58:37.470986 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:37.470951 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a2a91b-a448-4dfc-b2d1-e521c35649ea" path="/var/lib/kubelet/pods/73a2a91b-a448-4dfc-b2d1-e521c35649ea/volumes" Jul 28 14:58:37.478484 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:37.478434 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31adf145-e6e8-4ff7-a8d9-9b8653598e7a","Type":"ContainerStarted","Data":"af8a30342a7bd0d35219aeced24a7aaa733ee9fda0363f1852dafa4eeb6b7284"} Jul 28 14:58:37.478607 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:37.478518 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31adf145-e6e8-4ff7-a8d9-9b8653598e7a","Type":"ContainerStarted","Data":"a28a458bb01ab5cf538fa1da6223ecc99865ad5c7470b585d63fbc014edddfd0"} Jul 28 14:58:37.478607 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:37.478552 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31adf145-e6e8-4ff7-a8d9-9b8653598e7a","Type":"ContainerStarted","Data":"61faeeaaf3c460cb346c40ae8b835b2ac9e1d8a42cdffe0f8d03763be9feaaf2"} Jul 28 14:58:37.478607 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:37.478576 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31adf145-e6e8-4ff7-a8d9-9b8653598e7a","Type":"ContainerStarted","Data":"843256f4efc9e6350471f7953ddab398695ab0d4698a5bc3db47574b66b88a86"} Jul 28 14:58:37.478607 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:37.478598 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31adf145-e6e8-4ff7-a8d9-9b8653598e7a","Type":"ContainerStarted","Data":"c96e4d71ac61048948ef4bab8b39b2cccb65b97d582dff5dd89e66394cd6aa5a"} Jul 28 14:58:37.478763 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:37.478621 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31adf145-e6e8-4ff7-a8d9-9b8653598e7a","Type":"ContainerStarted","Data":"87351f13cb1bbd072615bcd68fc91f27abd609a224acb03ac9cb3652ac32c94a"} Jul 28 14:58:37.508616 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:37.508555 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.489848166 podStartE2EDuration="2.508533425s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.685259ms" isStatefulPod=false podCreationTimestamp="2026-07-28 14:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:58:37.506022287 +0000 UTC m=+198.749961332" watchObservedRunningTime="2026-07-28 14:58:37.508533425 +0000 UTC m=+198.752472471" Jul 28 14:58:40.843852 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:58:40.843809 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:59:35.843551 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:59:35.843515 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:59:35.858757 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:59:35.858729 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 14:59:36.721417 ip-10-0-129-173 kubenswrapper[2561]: I0728 14:59:36.721391 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 15:00:19.197175 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:00:19.197145 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 15:02:33.541817 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.541780 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8vzmz/must-gather-prx72"] Jul 28 15:02:33.545416 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.545397 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:02:33.547593 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.547571 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8vzmz\"/\"openshift-service-ca.crt\"" Jul 28 15:02:33.548308 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.548286 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8vzmz\"/\"kube-root-ca.crt\"" Jul 28 15:02:33.548404 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.548318 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8vzmz\"/\"default-dockercfg-hwjrx\"" Jul 28 15:02:33.553555 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.553536 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8vzmz/must-gather-prx72"] Jul 28 15:02:33.579652 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.579623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5m5k\" (UniqueName: \"kubernetes.io/projected/bbd0868c-872d-4e44-8fed-b3200bed7974-kube-api-access-t5m5k\") pod \"must-gather-prx72\" (UID: \"bbd0868c-872d-4e44-8fed-b3200bed7974\") " pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:02:33.579784 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.579681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbd0868c-872d-4e44-8fed-b3200bed7974-must-gather-output\") pod \"must-gather-prx72\" (UID: \"bbd0868c-872d-4e44-8fed-b3200bed7974\") " pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:02:33.680390 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.680362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5m5k\" (UniqueName: \"kubernetes.io/projected/bbd0868c-872d-4e44-8fed-b3200bed7974-kube-api-access-t5m5k\") pod \"must-gather-prx72\" (UID: \"bbd0868c-872d-4e44-8fed-b3200bed7974\") " pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:02:33.680568 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.680419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbd0868c-872d-4e44-8fed-b3200bed7974-must-gather-output\") pod \"must-gather-prx72\" (UID: \"bbd0868c-872d-4e44-8fed-b3200bed7974\") " pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:02:33.680766 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.680747 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbd0868c-872d-4e44-8fed-b3200bed7974-must-gather-output\") pod \"must-gather-prx72\" (UID: \"bbd0868c-872d-4e44-8fed-b3200bed7974\") " pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:02:33.688804 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.688784 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5m5k\" (UniqueName: \"kubernetes.io/projected/bbd0868c-872d-4e44-8fed-b3200bed7974-kube-api-access-t5m5k\") pod \"must-gather-prx72\" (UID: \"bbd0868c-872d-4e44-8fed-b3200bed7974\") " pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:02:33.865271 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.865192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:02:33.991155 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.991120 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8vzmz/must-gather-prx72"] Jul 28 15:02:33.994028 ip-10-0-129-173 kubenswrapper[2561]: W0728 15:02:33.993994 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbd0868c_872d_4e44_8fed_b3200bed7974.slice/crio-82eb080b40273fa33163df8db592885fb51327c4d68080706dba2225249a3537 WatchSource:0}: Error finding container 82eb080b40273fa33163df8db592885fb51327c4d68080706dba2225249a3537: Status 404 returned error can't find the container with id 82eb080b40273fa33163df8db592885fb51327c4d68080706dba2225249a3537 Jul 28 15:02:33.995799 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:33.995781 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 15:02:34.397805 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:34.397770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vzmz/must-gather-prx72" event={"ID":"bbd0868c-872d-4e44-8fed-b3200bed7974","Type":"ContainerStarted","Data":"82eb080b40273fa33163df8db592885fb51327c4d68080706dba2225249a3537"} Jul 28 15:02:40.431995 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:40.431956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vzmz/must-gather-prx72" event={"ID":"bbd0868c-872d-4e44-8fed-b3200bed7974","Type":"ContainerStarted","Data":"3e8c3c4855d2ceebdd3c26675ffa1f647c01d2839e61977f56b566f57b4608c9"} Jul 28 15:02:41.438917 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:41.438831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vzmz/must-gather-prx72" event={"ID":"bbd0868c-872d-4e44-8fed-b3200bed7974","Type":"ContainerStarted","Data":"68c9aa056a82ef92150913df8c06016a4581d10ce99f8635c57990be66d5ee0c"} Jul 28 15:02:41.454888 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:02:41.454816 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8vzmz/must-gather-prx72" podStartSLOduration=2.167879033 podStartE2EDuration="8.454797193s" totalImagesPullingTime="6.28691816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:02:41.454752064 +0000 UTC m=+442.698691109" watchObservedRunningTime="2026-07-28 15:02:41.454797193 +0000 UTC m=+442.698736238" Jul 28 15:03:26.646864 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:26.646828 2561 generic.go:356] "Generic (PLEG): container finished" podID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerID="3e8c3c4855d2ceebdd3c26675ffa1f647c01d2839e61977f56b566f57b4608c9" exitCode=0 Jul 28 15:03:26.647406 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:26.646908 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8vzmz/must-gather-prx72" event={"ID":"bbd0868c-872d-4e44-8fed-b3200bed7974","Type":"ContainerDied","Data":"3e8c3c4855d2ceebdd3c26675ffa1f647c01d2839e61977f56b566f57b4608c9"} Jul 28 15:03:26.647406 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:26.647344 2561 scope.go:117] "RemoveContainer" containerID="3e8c3c4855d2ceebdd3c26675ffa1f647c01d2839e61977f56b566f57b4608c9" Jul 28 15:03:27.093005 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:27.092974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8vzmz_must-gather-prx72_bbd0868c-872d-4e44-8fed-b3200bed7974/gather/0.log" Jul 28 15:03:30.104908 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:30.104874 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5twhq_dcab16c8-c85a-4c5f-9bb2-2d0e5c97d165/global-pull-secret-syncer/0.log" Jul 28 15:03:30.309985 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:30.309953 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xljgs_8d3df34e-f920-4f2a-a4fc-473d8b05e772/konnectivity-agent/0.log" Jul 28 15:03:30.332740 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:30.332709 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-173.ec2.internal_5521078145c4ebdc55ed01091d72db27/haproxy/0.log" Jul 28 15:03:32.449835 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.449798 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-8vzmz/must-gather-prx72"] Jul 28 15:03:32.450318 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.449975 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-8vzmz/must-gather-prx72" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerName="copy" containerID="cri-o://68c9aa056a82ef92150913df8c06016a4581d10ce99f8635c57990be66d5ee0c" gracePeriod=2 Jul 28 15:03:32.454869 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.454847 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-8vzmz/must-gather-prx72"] Jul 28 15:03:32.673582 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.673557 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8vzmz_must-gather-prx72_bbd0868c-872d-4e44-8fed-b3200bed7974/copy/0.log" Jul 28 15:03:32.673987 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.673954 2561 generic.go:356] "Generic (PLEG): container finished" podID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerID="68c9aa056a82ef92150913df8c06016a4581d10ce99f8635c57990be66d5ee0c" exitCode=143 Jul 28 15:03:32.688052 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.688032 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8vzmz_must-gather-prx72_bbd0868c-872d-4e44-8fed-b3200bed7974/copy/0.log" Jul 28 15:03:32.690606 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.690588 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:03:32.692965 ip-10-0-129-173 kubenswrapper[2561]: E0728 15:03:32.692939 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-prx72\" is forbidden: User \"system:node:ip-10-0-129-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-8vzmz\": no relationship found between node 'ip-10-0-129-173.ec2.internal' and this object" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:03:32.805709 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.805627 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5m5k\" (UniqueName: \"kubernetes.io/projected/bbd0868c-872d-4e44-8fed-b3200bed7974-kube-api-access-t5m5k\") pod \"bbd0868c-872d-4e44-8fed-b3200bed7974\" (UID: \"bbd0868c-872d-4e44-8fed-b3200bed7974\") " Jul 28 15:03:32.805709 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.805685 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbd0868c-872d-4e44-8fed-b3200bed7974-must-gather-output\") pod \"bbd0868c-872d-4e44-8fed-b3200bed7974\" (UID: \"bbd0868c-872d-4e44-8fed-b3200bed7974\") " Jul 28 15:03:32.807085 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.807055 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd0868c-872d-4e44-8fed-b3200bed7974-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "bbd0868c-872d-4e44-8fed-b3200bed7974" (UID: "bbd0868c-872d-4e44-8fed-b3200bed7974"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 15:03:32.807988 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.807963 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd0868c-872d-4e44-8fed-b3200bed7974-kube-api-access-t5m5k" (OuterVolumeSpecName: "kube-api-access-t5m5k") pod "bbd0868c-872d-4e44-8fed-b3200bed7974" (UID: "bbd0868c-872d-4e44-8fed-b3200bed7974"). InnerVolumeSpecName "kube-api-access-t5m5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 15:03:32.906815 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.906774 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5m5k\" (UniqueName: \"kubernetes.io/projected/bbd0868c-872d-4e44-8fed-b3200bed7974-kube-api-access-t5m5k\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 15:03:32.906815 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:32.906806 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bbd0868c-872d-4e44-8fed-b3200bed7974-must-gather-output\") on node \"ip-10-0-129-173.ec2.internal\" DevicePath \"\"" Jul 28 15:03:33.470639 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.470608 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" path="/var/lib/kubelet/pods/bbd0868c-872d-4e44-8fed-b3200bed7974/volumes" Jul 28 15:03:33.678836 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.678804 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8vzmz_must-gather-prx72_bbd0868c-872d-4e44-8fed-b3200bed7974/copy/0.log" Jul 28 15:03:33.679237 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.679216 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8vzmz/must-gather-prx72" Jul 28 15:03:33.679309 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.679240 2561 scope.go:117] "RemoveContainer" containerID="68c9aa056a82ef92150913df8c06016a4581d10ce99f8635c57990be66d5ee0c" Jul 28 15:03:33.687060 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.687038 2561 scope.go:117] "RemoveContainer" containerID="3e8c3c4855d2ceebdd3c26675ffa1f647c01d2839e61977f56b566f57b4608c9" Jul 28 15:03:33.701684 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.701666 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-jdv58_2dbad3ae-1dde-4055-9c15-47fa09b1c18b/cluster-monitoring-operator/0.log" Jul 28 15:03:33.879867 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.879781 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b4c77b7bf-rzkmr_eaf84110-9953-4139-a878-088953999daa/metrics-server/0.log" Jul 28 15:03:33.922349 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.922322 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-l8ndk_eaafcef7-72ca-4540-9048-ab205ab99523/monitoring-plugin/0.log" Jul 28 15:03:33.967148 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.967123 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gblh7_611b91b1-374b-4942-8cf2-e030d66f210a/node-exporter/0.log" Jul 28 15:03:33.998579 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:33.998533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gblh7_611b91b1-374b-4942-8cf2-e030d66f210a/kube-rbac-proxy/0.log" Jul 28 15:03:34.027711 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.027684 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gblh7_611b91b1-374b-4942-8cf2-e030d66f210a/init-textfile/0.log" Jul 28 15:03:34.223099 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.223072 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qjgqz_93c665a4-63c1-49cb-8944-19ef4857a2f0/kube-rbac-proxy-main/0.log" Jul 28 15:03:34.245670 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.245643 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qjgqz_93c665a4-63c1-49cb-8944-19ef4857a2f0/kube-rbac-proxy-self/0.log" Jul 28 15:03:34.272160 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.272125 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-qjgqz_93c665a4-63c1-49cb-8944-19ef4857a2f0/openshift-state-metrics/0.log" Jul 28 15:03:34.319007 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.318978 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31adf145-e6e8-4ff7-a8d9-9b8653598e7a/prometheus/0.log" Jul 28 15:03:34.344827 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.344804 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31adf145-e6e8-4ff7-a8d9-9b8653598e7a/config-reloader/0.log" Jul 28 15:03:34.375512 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.375486 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31adf145-e6e8-4ff7-a8d9-9b8653598e7a/thanos-sidecar/0.log" Jul 28 15:03:34.401892 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.401870 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31adf145-e6e8-4ff7-a8d9-9b8653598e7a/kube-rbac-proxy-web/0.log" Jul 28 15:03:34.436239 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.436217 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31adf145-e6e8-4ff7-a8d9-9b8653598e7a/kube-rbac-proxy/0.log" Jul 28 15:03:34.459233 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.459199 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31adf145-e6e8-4ff7-a8d9-9b8653598e7a/kube-rbac-proxy-thanos/0.log" Jul 28 15:03:34.486763 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.486695 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31adf145-e6e8-4ff7-a8d9-9b8653598e7a/init-config-reloader/0.log" Jul 28 15:03:34.519576 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.519550 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pz5lh_74080a10-7a94-4264-881c-381838974960/prometheus-operator/0.log" Jul 28 15:03:34.545218 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.545188 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pz5lh_74080a10-7a94-4264-881c-381838974960/kube-rbac-proxy/0.log" Jul 28 15:03:34.755589 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.755509 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9466c66-cq659_6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888/thanos-query/0.log" Jul 28 15:03:34.783124 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.783093 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9466c66-cq659_6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888/kube-rbac-proxy-web/0.log" Jul 28 15:03:34.808732 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.808711 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9466c66-cq659_6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888/kube-rbac-proxy/0.log" Jul 28 15:03:34.835657 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.835629 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9466c66-cq659_6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888/prom-label-proxy/0.log" Jul 28 15:03:34.859905 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.859881 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9466c66-cq659_6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888/kube-rbac-proxy-rules/0.log" Jul 28 15:03:34.884046 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:34.884022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-9466c66-cq659_6e2c2db4-76f4-4eb8-b9f2-aa0be3e1f888/kube-rbac-proxy-metrics/0.log" Jul 28 15:03:38.041391 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.041357 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts"] Jul 28 15:03:38.041795 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.041739 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerName="copy" Jul 28 15:03:38.041795 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.041751 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerName="copy" Jul 28 15:03:38.041795 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.041766 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerName="gather" Jul 28 15:03:38.041795 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.041772 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerName="gather" Jul 28 15:03:38.041921 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.041823 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerName="gather" Jul 28 15:03:38.041921 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.041833 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd0868c-872d-4e44-8fed-b3200bed7974" containerName="copy" Jul 28 15:03:38.046756 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.046735 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.049032 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.049015 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dlh4n\"/\"openshift-service-ca.crt\"" Jul 28 15:03:38.049093 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.049070 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dlh4n\"/\"kube-root-ca.crt\"" Jul 28 15:03:38.049719 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.049700 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dlh4n\"/\"default-dockercfg-45gz8\"" Jul 28 15:03:38.051912 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.051891 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts"] Jul 28 15:03:38.155881 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.155848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-lib-modules\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.156063 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.155886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-sys\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.156063 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.155910 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-podres\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.156063 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.155958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6rdx\" (UniqueName: \"kubernetes.io/projected/e6f7237e-ccf5-4d13-b958-61325c5b08e4-kube-api-access-g6rdx\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.156063 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.156033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-proc\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257146 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-lib-modules\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257146 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-sys\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257378 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-podres\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257378 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6rdx\" (UniqueName: \"kubernetes.io/projected/e6f7237e-ccf5-4d13-b958-61325c5b08e4-kube-api-access-g6rdx\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257378 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-proc\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257378 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257257 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-sys\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257378 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257303 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-proc\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257378 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257301 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-lib-modules\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.257378 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.257301 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6f7237e-ccf5-4d13-b958-61325c5b08e4-podres\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.266389 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.266368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6rdx\" (UniqueName: \"kubernetes.io/projected/e6f7237e-ccf5-4d13-b958-61325c5b08e4-kube-api-access-g6rdx\") pod \"perf-node-gather-daemonset-97dts\" (UID: \"e6f7237e-ccf5-4d13-b958-61325c5b08e4\") " pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.357569 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.357469 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.396342 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.396314 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cqjcd_fe15fa41-8f88-4009-86bf-e3182137eacb/dns/0.log" Jul 28 15:03:38.418294 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.418269 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cqjcd_fe15fa41-8f88-4009-86bf-e3182137eacb/kube-rbac-proxy/0.log" Jul 28 15:03:38.486428 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.486395 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts"] Jul 28 15:03:38.489456 ip-10-0-129-173 kubenswrapper[2561]: W0728 15:03:38.489414 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode6f7237e_ccf5_4d13_b958_61325c5b08e4.slice/crio-d2791340db6b4d8d5e721b41a78b79206596d42442bf7b49ad89e272a78d8068 WatchSource:0}: Error finding container d2791340db6b4d8d5e721b41a78b79206596d42442bf7b49ad89e272a78d8068: Status 404 returned error can't find the container with id d2791340db6b4d8d5e721b41a78b79206596d42442bf7b49ad89e272a78d8068 Jul 28 15:03:38.504371 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.504354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d99pr_8db45231-7e81-4ae8-bd6d-6156af2f68da/dns-node-resolver/0.log" Jul 28 15:03:38.703416 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.703375 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" event={"ID":"e6f7237e-ccf5-4d13-b958-61325c5b08e4","Type":"ContainerStarted","Data":"7f39389943cfd03672df72a15a69c3cfa62a6c835b2ec303f8df1d98d221b5c9"} Jul 28 15:03:38.703640 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.703433 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" event={"ID":"e6f7237e-ccf5-4d13-b958-61325c5b08e4","Type":"ContainerStarted","Data":"d2791340db6b4d8d5e721b41a78b79206596d42442bf7b49ad89e272a78d8068"} Jul 28 15:03:38.703640 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.703580 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:38.720468 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.720170 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" podStartSLOduration=0.720150262 podStartE2EDuration="720.150262ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:03:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:03:38.718823011 +0000 UTC m=+499.962762055" watchObservedRunningTime="2026-07-28 15:03:38.720150262 +0000 UTC m=+499.964089309" Jul 28 15:03:38.960687 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:38.960609 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-82hgb_c63b8314-0511-457e-83a0-d65b438a79f1/node-ca/0.log" Jul 28 15:03:39.634993 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:39.634966 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f6c796b55-6rppj_00e0aa4c-b35f-4423-866c-72612c0498fe/router/0.log" Jul 28 15:03:39.917872 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:39.917845 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ftx8w_2ef4be95-b8a3-4fdd-9328-6b682672fad2/serve-healthcheck-canary/0.log" Jul 28 15:03:40.271777 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:40.271701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-569lv_2dd74425-afae-4808-a442-c4ec82f416d9/insights-operator/1.log" Jul 28 15:03:40.271777 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:40.271728 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-569lv_2dd74425-afae-4808-a442-c4ec82f416d9/insights-operator/0.log" Jul 28 15:03:40.367918 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:40.367889 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nvmct_65ef832d-c07f-44c0-ac5e-974c77ed07de/kube-rbac-proxy/0.log" Jul 28 15:03:40.392351 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:40.392325 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nvmct_65ef832d-c07f-44c0-ac5e-974c77ed07de/exporter/0.log" Jul 28 15:03:40.415761 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:40.415732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nvmct_65ef832d-c07f-44c0-ac5e-974c77ed07de/extractor/0.log" Jul 28 15:03:44.717678 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:44.717644 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dlh4n/perf-node-gather-daemonset-97dts" Jul 28 15:03:45.024772 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:45.024694 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn_15a72792-c48e-4843-a853-888cba7646a3/kube-storage-version-migrator-operator/1.log" Jul 28 15:03:45.025472 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:45.025436 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-qmkrn_15a72792-c48e-4843-a853-888cba7646a3/kube-storage-version-migrator-operator/0.log" Jul 28 15:03:46.197642 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.197614 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxgvq_967987f0-7502-49d4-abd8-2c27df878b26/kube-multus-additional-cni-plugins/0.log" Jul 28 15:03:46.235417 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.235387 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxgvq_967987f0-7502-49d4-abd8-2c27df878b26/egress-router-binary-copy/0.log" Jul 28 15:03:46.263851 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.263819 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxgvq_967987f0-7502-49d4-abd8-2c27df878b26/cni-plugins/0.log" Jul 28 15:03:46.290256 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.290225 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxgvq_967987f0-7502-49d4-abd8-2c27df878b26/bond-cni-plugin/0.log" Jul 28 15:03:46.312737 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.312709 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxgvq_967987f0-7502-49d4-abd8-2c27df878b26/routeoverride-cni/0.log" Jul 28 15:03:46.334810 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.334783 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxgvq_967987f0-7502-49d4-abd8-2c27df878b26/whereabouts-cni-bincopy/0.log" Jul 28 15:03:46.354396 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.354370 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xxgvq_967987f0-7502-49d4-abd8-2c27df878b26/whereabouts-cni/0.log" Jul 28 15:03:46.383356 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.383320 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mt7wg_a506c49d-8572-4cc0-9efc-844fc28f8f06/kube-multus/0.log" Jul 28 15:03:46.443680 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.443651 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-246q4_a4296243-f2f2-41db-b931-eb6e89110195/network-metrics-daemon/0.log" Jul 28 15:03:46.470484 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.470392 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-246q4_a4296243-f2f2-41db-b931-eb6e89110195/kube-rbac-proxy/0.log" Jul 28 15:03:46.634243 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.634203 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-697bb9894d-84hgw"] Jul 28 15:03:46.637745 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.637719 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.639997 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.639969 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 15:03:46.640159 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.640111 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 15:03:46.640220 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.640184 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 15:03:46.640904 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.640884 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 15:03:46.641022 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.640890 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 15:03:46.641079 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.641024 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 15:03:46.641773 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.641745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 15:03:46.641773 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.641745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47c62\"" Jul 28 15:03:46.645731 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.645711 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 15:03:46.648388 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.648369 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697bb9894d-84hgw"] Jul 28 15:03:46.732893 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.732817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-console-config\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.732893 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.732885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl8tg\" (UniqueName: \"kubernetes.io/projected/ce12b90f-69a3-4275-876f-03eea437727c-kube-api-access-cl8tg\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.733101 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.732932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce12b90f-69a3-4275-876f-03eea437727c-console-oauth-config\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.733101 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.732997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-oauth-serving-cert\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.733101 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.733021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-trusted-ca-bundle\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.733101 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.733082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce12b90f-69a3-4275-876f-03eea437727c-console-serving-cert\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.733101 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.733102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-service-ca\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.834609 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.834567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-oauth-serving-cert\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.834609 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.834613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-trusted-ca-bundle\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.834877 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.834732 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce12b90f-69a3-4275-876f-03eea437727c-console-serving-cert\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.834877 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.834767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-service-ca\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.834988 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.834893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-console-config\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.835048 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.834982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl8tg\" (UniqueName: \"kubernetes.io/projected/ce12b90f-69a3-4275-876f-03eea437727c-kube-api-access-cl8tg\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.835101 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.835048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce12b90f-69a3-4275-876f-03eea437727c-console-oauth-config\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.835374 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.835346 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-oauth-serving-cert\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.835514 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.835490 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-service-ca\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.835605 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.835548 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-console-config\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.835747 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.835722 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce12b90f-69a3-4275-876f-03eea437727c-trusted-ca-bundle\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.837291 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.837269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce12b90f-69a3-4275-876f-03eea437727c-console-serving-cert\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.837390 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.837323 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce12b90f-69a3-4275-876f-03eea437727c-console-oauth-config\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.843575 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.843554 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl8tg\" (UniqueName: \"kubernetes.io/projected/ce12b90f-69a3-4275-876f-03eea437727c-kube-api-access-cl8tg\") pod \"console-697bb9894d-84hgw\" (UID: \"ce12b90f-69a3-4275-876f-03eea437727c\") " pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:46.947872 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:46.947847 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697bb9894d-84hgw" Jul 28 15:03:47.086916 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.086883 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697bb9894d-84hgw"] Jul 28 15:03:47.089921 ip-10-0-129-173 kubenswrapper[2561]: W0728 15:03:47.089889 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce12b90f_69a3_4275_876f_03eea437727c.slice/crio-aecc4e682972fa7760c496347c46fac403794311c2a69454135ad895de43fccb WatchSource:0}: Error finding container aecc4e682972fa7760c496347c46fac403794311c2a69454135ad895de43fccb: Status 404 returned error can't find the container with id aecc4e682972fa7760c496347c46fac403794311c2a69454135ad895de43fccb Jul 28 15:03:47.641994 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.641920 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9wdd_a7b92eaf-459b-48d8-9124-a4a81474e0b7/ovn-controller/0.log" Jul 28 15:03:47.661189 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.661162 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9wdd_a7b92eaf-459b-48d8-9124-a4a81474e0b7/ovn-acl-logging/0.log" Jul 28 15:03:47.681975 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.681945 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9wdd_a7b92eaf-459b-48d8-9124-a4a81474e0b7/kube-rbac-proxy-node/0.log" Jul 28 15:03:47.702632 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.702602 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9wdd_a7b92eaf-459b-48d8-9124-a4a81474e0b7/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 15:03:47.720902 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.720872 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9wdd_a7b92eaf-459b-48d8-9124-a4a81474e0b7/northd/0.log" Jul 28 15:03:47.742390 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.742360 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9wdd_a7b92eaf-459b-48d8-9124-a4a81474e0b7/nbdb/0.log" Jul 28 15:03:47.743213 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.743184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697bb9894d-84hgw" event={"ID":"ce12b90f-69a3-4275-876f-03eea437727c","Type":"ContainerStarted","Data":"0be31ead1507fa408ecd0de6175821755593d29cf2ec1cbca0a0f9192db7fdf6"} Jul 28 15:03:47.743352 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.743234 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697bb9894d-84hgw" event={"ID":"ce12b90f-69a3-4275-876f-03eea437727c","Type":"ContainerStarted","Data":"aecc4e682972fa7760c496347c46fac403794311c2a69454135ad895de43fccb"} Jul 28 15:03:47.759742 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.759700 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-697bb9894d-84hgw" podStartSLOduration=1.759685716 podStartE2EDuration="1.759685716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:03:47.758554214 +0000 UTC m=+509.002493242" watchObservedRunningTime="2026-07-28 15:03:47.759685716 +0000 UTC m=+509.003624761" Jul 28 15:03:47.762653 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.762631 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9wdd_a7b92eaf-459b-48d8-9124-a4a81474e0b7/sbdb/0.log" Jul 28 15:03:47.802708 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:47.802680 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t9wdd_a7b92eaf-459b-48d8-9124-a4a81474e0b7/ovnkube-controller/0.log" Jul 28 15:03:49.020005 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:49.019926 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kfhzq_22d5e416-87ce-47db-9b63-341066302104/network-check-target-container/0.log" Jul 28 15:03:49.909974 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:49.909934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-q47hb_868f8bed-0440-4b1f-a42e-d5e5c65a96f2/iptables-alerter/0.log" Jul 28 15:03:50.510024 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:50.509995 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9m5vc_78df0d9e-d6f1-4bd4-85db-194eb3ff1509/tuned/0.log" Jul 28 15:03:52.066960 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:52.066932 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-kflpj_db8de329-1652-4e2c-9d1a-07c503825b60/cluster-samples-operator/0.log" Jul 28 15:03:52.083277 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:52.083249 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-kflpj_db8de329-1652-4e2c-9d1a-07c503825b60/cluster-samples-operator-watch/0.log" Jul 28 15:03:53.191703 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:53.191660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-658d7b7c78-mg7wv_9dde6f91-1675-4b99-b75e-f097d87d6bed/service-ca-controller/0.log" Jul 28 15:03:53.601163 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:53.601137 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s6tsr_d74c6fe6-843d-45df-9f14-4bd1b27ffb01/csi-driver/0.log" Jul 28 15:03:53.620645 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:53.620620 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s6tsr_d74c6fe6-843d-45df-9f14-4bd1b27ffb01/csi-node-driver-registrar/0.log" Jul 28 15:03:53.643343 ip-10-0-129-173 kubenswrapper[2561]: I0728 15:03:53.643311 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-s6tsr_d74c6fe6-843d-45df-9f14-4bd1b27ffb01/csi-liveness-probe/0.log"