Sep 11 08:46:33.721696 ip-10-0-138-35 systemd[1]: Starting Kubernetes Kubelet... Sep 11 08:46:34.115752 ip-10-0-138-35 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 08:46:34.115752 ip-10-0-138-35 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 08:46:34.115752 ip-10-0-138-35 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 08:46:34.115752 ip-10-0-138-35 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 08:46:34.115752 ip-10-0-138-35 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 08:46:34.116491 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.115792 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 08:46:34.122033 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122010 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 08:46:34.122033 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122030 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 11 08:46:34.122033 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122035 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 08:46:34.122033 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122038 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 08:46:34.122033 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122042 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122045 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122048 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122051 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122054 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122057 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122060 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122067 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122072 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122076 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122080 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122090 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122094 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122097 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122100 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122103 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122106 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122108 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122111 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 08:46:34.122222 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122117 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122120 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122122 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122125 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122128 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122131 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122134 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122136 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122139 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122142 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122144 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122147 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122150 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122155 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122158 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122163 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122165 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122168 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122171 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122174 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 08:46:34.122734 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122177 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122180 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122182 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122185 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122187 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122198 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122202 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122205 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122209 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122212 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122215 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122217 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122220 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122223 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122226 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122228 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122231 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122236 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122239 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 08:46:34.123228 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122242 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122244 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122247 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122250 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122253 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122256 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122259 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122262 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122264 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122267 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122269 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122275 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122277 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122280 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122283 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122285 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122288 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122291 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122293 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122302 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 08:46:34.123700 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122304 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122307 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122310 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122312 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122317 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122320 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122324 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122326 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122329 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122331 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122334 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122337 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122339 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122342 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122345 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122350 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.122353 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123564 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123572 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123576 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 08:46:34.124190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123579 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123582 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123585 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123588 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123590 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123593 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123596 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123601 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123604 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123607 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123610 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123613 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123621 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123624 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123626 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123629 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123632 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123634 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123637 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 08:46:34.124681 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123640 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123645 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123647 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123650 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123653 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123655 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123660 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123662 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123666 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123669 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123672 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123675 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123678 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123683 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123685 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123688 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123691 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123694 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123697 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123699 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 08:46:34.125276 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123702 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123705 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123707 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123710 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123713 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123716 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123726 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123729 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123734 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123738 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123741 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123743 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123746 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123749 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123753 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123757 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123760 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123766 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123769 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 08:46:34.125818 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123772 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123775 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123778 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123781 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123784 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123787 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123789 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123792 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123794 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123797 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123800 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123805 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123808 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123810 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123814 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123818 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123822 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123825 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123828 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 08:46:34.126286 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123830 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123838 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123841 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123846 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123849 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123852 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123855 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123857 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123860 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123863 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123872 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123874 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123877 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123880 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123883 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123885 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123890 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123893 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.123896 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124570 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 08:46:34.126769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124576 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124578 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124584 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124587 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124589 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124592 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124595 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124598 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124602 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124606 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124609 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124612 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124615 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124624 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124630 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124632 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124636 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124639 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124642 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124644 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 08:46:34.127261 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124647 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124650 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124653 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124655 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124659 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124661 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124667 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124670 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124672 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124675 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124678 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124681 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124684 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124687 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124689 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124692 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124695 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124698 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124700 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 08:46:34.127772 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124705 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124708 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124710 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124719 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124722 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124725 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124728 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124736 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124739 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124742 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124745 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124747 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124752 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124755 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124757 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124760 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124763 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124766 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124768 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 08:46:34.128238 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124772 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124775 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124778 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124781 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124784 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124789 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124792 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124794 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124797 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124805 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124808 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124811 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124814 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124816 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124819 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124821 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124824 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124830 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124833 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124836 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 08:46:34.128711 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124838 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124846 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124849 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124856 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124859 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124861 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124864 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124867 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124869 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124874 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124877 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124880 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124883 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124885 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124888 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124890 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124893 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124896 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124898 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.124903 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125100 2584 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 08:46:34.129207 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125196 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125232 2584 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125237 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125241 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125245 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125249 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125253 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125257 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125260 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125263 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125266 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125269 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125272 2584 flags.go:64] FLAG: --cgroup-root="" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125275 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125279 2584 flags.go:64] FLAG: --client-ca-file="" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125282 2584 flags.go:64] FLAG: --cloud-provider="external" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125286 2584 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125291 2584 flags.go:64] FLAG: --cluster-domain="" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125294 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125297 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125300 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125304 2584 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125317 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 08:46:34.129727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125321 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125324 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125328 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125331 2584 flags.go:64] FLAG: --contention-profiling="false" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125334 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125337 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125340 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125343 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125347 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125354 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125357 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125360 2584 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125363 2584 flags.go:64] FLAG: --enable-server="true" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125366 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125373 2584 flags.go:64] FLAG: --event-burst="100" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125377 2584 flags.go:64] FLAG: --event-qps="50" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125382 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125387 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125390 2584 flags.go:64] FLAG: --eviction-hard="" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125395 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125398 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125401 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125414 2584 flags.go:64] FLAG: --eviction-soft="" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125417 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125420 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 08:46:34.130271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125424 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125427 2584 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125430 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125433 2584 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125438 2584 flags.go:64] FLAG: --feature-gates="" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125451 2584 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125456 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125459 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125463 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125468 2584 flags.go:64] FLAG: --healthz-port="10248" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125471 2584 flags.go:64] FLAG: --help="false" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125474 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125477 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125480 2584 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125483 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125487 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125493 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125496 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125499 2584 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125502 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125504 2584 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125514 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125518 2584 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125521 2584 flags.go:64] FLAG: --kube-reserved="" Sep 11 08:46:34.130924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125524 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125527 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125530 2584 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125532 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125535 2584 flags.go:64] FLAG: --lock-file="" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125538 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125541 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125544 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125549 2584 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125553 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125556 2584 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125559 2584 flags.go:64] FLAG: --logging-format="text" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125561 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125565 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125567 2584 flags.go:64] FLAG: --manifest-url="" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125570 2584 flags.go:64] FLAG: --manifest-url-header="" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125575 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125578 2584 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125582 2584 flags.go:64] FLAG: --max-pods="110" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125585 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125588 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125590 2584 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125593 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125596 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125601 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 08:46:34.131523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125604 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125611 2584 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125614 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125618 2584 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125621 2584 flags.go:64] FLAG: --pod-cidr="" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125623 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125628 2584 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125631 2584 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125634 2584 flags.go:64] FLAG: --pods-per-core="0" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125637 2584 flags.go:64] FLAG: --port="10250" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125640 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125643 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0be80131c76720028" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125646 2584 flags.go:64] FLAG: --qos-reserved="" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125649 2584 flags.go:64] FLAG: --read-only-port="10255" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125653 2584 flags.go:64] FLAG: --register-node="true" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125655 2584 flags.go:64] FLAG: --register-with-taints="" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125659 2584 flags.go:64] FLAG: --registry-burst="10" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125662 2584 flags.go:64] FLAG: --registry-qps="5" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125665 2584 flags.go:64] FLAG: --reserved-cpus="" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125668 2584 flags.go:64] FLAG: --reserved-memory="" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125672 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125675 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125678 2584 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125681 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125684 2584 flags.go:64] FLAG: --runonce="false" Sep 11 08:46:34.132160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125686 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125689 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125692 2584 flags.go:64] FLAG: --seccomp-default="false" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125695 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125698 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125701 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125704 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125709 2584 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125712 2584 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125715 2584 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125718 2584 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125721 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125724 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125727 2584 flags.go:64] FLAG: --system-cgroups="" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125730 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125737 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125739 2584 flags.go:64] FLAG: --tls-cert-file="" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125742 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125746 2584 flags.go:64] FLAG: --tls-min-version="" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125749 2584 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125752 2584 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125755 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125758 2584 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125761 2584 flags.go:64] FLAG: --v="2" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125765 2584 flags.go:64] FLAG: --version="false" Sep 11 08:46:34.132790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125769 2584 flags.go:64] FLAG: --vmodule="" Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125773 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.125777 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125916 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125922 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125925 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125929 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125932 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125936 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125938 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125941 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125944 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125947 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125951 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125956 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125959 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125962 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125965 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125968 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 08:46:34.133397 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125971 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125973 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125976 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125979 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125982 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125992 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125994 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.125997 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126000 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126003 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126005 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126008 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126011 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126013 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126017 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126019 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126022 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126024 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126027 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126032 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 11 08:46:34.133890 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126035 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126037 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126040 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126042 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126046 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126050 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126053 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126056 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126059 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126062 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126064 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126068 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126070 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126073 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126076 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126078 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126081 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126083 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126086 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 08:46:34.134420 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126088 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126091 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126094 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126096 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126099 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126102 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126104 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126107 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126110 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126112 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126115 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126117 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126121 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126124 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126126 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126129 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126132 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126134 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126137 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126140 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 08:46:34.134883 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126142 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126145 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126148 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126151 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126153 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126156 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126159 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126161 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126164 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126166 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126169 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126172 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126174 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126177 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126179 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126182 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126185 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126187 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126190 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126192 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 08:46:34.135371 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126195 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126198 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126201 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.126203 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.126210 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.133636 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.133651 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.134435 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.134444 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134508 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134514 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134517 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134521 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134524 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 08:46:34.135862 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134527 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134529 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134532 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134535 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134537 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134540 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134543 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134545 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134548 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134551 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134553 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134556 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134559 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134562 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134564 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134567 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134569 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134572 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134574 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134577 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 08:46:34.136225 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134580 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134582 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134585 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134587 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134592 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134597 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134600 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134603 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134606 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134609 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134612 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134615 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134617 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134620 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134623 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134625 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134628 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134630 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134633 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 08:46:34.136730 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134635 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134638 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134641 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134644 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134646 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134649 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134652 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134654 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134658 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134662 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134665 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134667 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134670 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134673 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134675 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134678 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134680 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134683 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134687 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134690 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 08:46:34.137190 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134692 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134695 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134697 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134700 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134702 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134705 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134707 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134710 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134712 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134715 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134718 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134720 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134723 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134725 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134728 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134732 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134735 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134738 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134741 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 08:46:34.137886 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134744 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134747 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134749 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134753 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134755 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134758 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134761 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134764 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134767 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134769 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134772 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134775 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134778 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134781 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134784 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 08:46:34.138378 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134787 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.134792 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134918 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134924 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134927 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134931 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134935 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134938 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134940 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134943 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134946 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134950 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134954 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 08:46:34.138762 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134959 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134961 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134964 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134967 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134970 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134973 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134976 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134979 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134981 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134984 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134986 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134989 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134991 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134994 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.134997 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135000 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135002 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135008 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135011 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135013 2584 feature_gate.go:328] unrecognized feature gate: Example Sep 11 08:46:34.139087 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135016 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135018 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135021 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135024 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135026 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135028 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135031 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135034 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135036 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135039 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135041 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135044 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135046 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135049 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135051 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135054 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135057 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135059 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135062 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135065 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 08:46:34.139583 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135068 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135070 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135073 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135075 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135078 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135080 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135083 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135085 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135088 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135091 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135098 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135101 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135104 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135107 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135110 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135112 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135115 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135117 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135120 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135122 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 08:46:34.140069 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135125 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135127 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135129 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135132 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135135 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135137 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135140 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135142 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135145 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135148 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135155 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135158 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135160 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135163 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135166 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135168 2584 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135170 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135173 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135176 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135179 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 08:46:34.140567 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135181 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135184 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135187 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135193 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135196 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135198 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135201 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:34.135203 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.135209 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.135314 2584 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.138050 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.139040 2584 server.go:1019] "Starting client certificate rotation" Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.139139 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 08:46:34.141060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.139174 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 08:46:34.141390 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.141376 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 08:46:34.142803 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.142775 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 08:46:34.156541 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.156518 2584 log.go:25] "Validated CRI v1 runtime API" Sep 11 08:46:34.160148 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.160121 2584 log.go:25] "Validated CRI v1 image API" Sep 11 08:46:34.160983 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.160970 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 08:46:34.165268 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.165248 2584 fs.go:135] Filesystem UUIDs: map[4dd687cc-a918-4119-8646-2e813a50cffe:/dev/nvme0n1p3 71de0dbf-4090-4120-88f5-a44a1c0242e5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 11 08:46:34.165328 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.165268 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 08:46:34.168995 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.168962 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 08:46:34.170586 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.170470 2584 manager.go:216] Machine: {Timestamp:2026-09-11 08:46:34.169036669 +0000 UTC m=+0.332886031 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099826 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c84886723edad6b6b46ead49b7a6b SystemUUID:ec2c8488-6723-edad-6b6b-46ead49b7a6b BootID:96283cc5-b21a-4eae-9875-36baf4c3e55e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:1d:3d:5b:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:1d:3d:5b:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:4a:77:7e:07:0c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 08:46:34.170586 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.170576 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 08:46:34.170748 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.170685 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 08:46:34.173780 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.173752 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 08:46:34.173947 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.173782 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 08:46:34.174450 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.174438 2584 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 08:46:34.174505 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.174455 2584 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 08:46:34.174505 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.174466 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 08:46:34.175099 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.175088 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 08:46:34.175967 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.175956 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 08:46:34.178691 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.178678 2584 state_mem.go:36] "Initialized new in-memory state store" Sep 11 08:46:34.178837 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.178826 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 08:46:34.178902 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.178862 2584 kubelet.go:486] "Attempting to sync node with API server" Sep 11 08:46:34.178902 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.178876 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 08:46:34.178902 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.178891 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 08:46:34.179020 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.178905 2584 kubelet.go:398] "Adding apiserver pod source" Sep 11 08:46:34.179020 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.178918 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 08:46:34.179300 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.179287 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 08:46:34.179363 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.179312 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 08:46:34.181621 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.181605 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 08:46:34.183594 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.183574 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r8gk7" Sep 11 08:46:34.183835 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.183821 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 08:46:34.183888 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.183856 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 08:46:34.185889 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185877 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 08:46:34.185934 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185896 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 08:46:34.185934 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185902 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 08:46:34.185934 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185908 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 08:46:34.185934 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185919 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 08:46:34.185934 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185925 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 08:46:34.186070 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185938 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 08:46:34.186070 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185944 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 08:46:34.186070 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185950 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 08:46:34.186070 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185957 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 08:46:34.186070 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185977 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 08:46:34.186070 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.185983 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 08:46:34.186868 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.186855 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 08:46:34.186925 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.186874 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 08:46:34.188118 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.188097 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 08:46:34.188252 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.188228 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 08:46:34.188317 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.188228 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 08:46:34.190452 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.190438 2584 server.go:1268] "Started kubelet" Sep 11 08:46:34.190531 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.190500 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 08:46:34.190596 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.190549 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 08:46:34.190659 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.190622 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 08:46:34.191014 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.190995 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r8gk7" Sep 11 08:46:34.191375 ip-10-0-138-35 systemd[1]: Started Kubernetes Kubelet. Sep 11 08:46:34.192635 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.192616 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 08:46:34.192858 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.192841 2584 server.go:310] "Adding debug handlers to kubelet server" Sep 11 08:46:34.198510 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.198485 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 08:46:34.198740 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.198725 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 08:46:34.199300 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.199279 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 08:46:34.199386 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.199365 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:34.199916 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.199898 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 08:46:34.199998 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.199920 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 08:46:34.199998 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.199901 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 08:46:34.200115 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200018 2584 reconstruct.go:97] "Volume reconstruction finished" Sep 11 08:46:34.200115 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200026 2584 reconciler.go:29] "Reconciler: start to sync state" Sep 11 08:46:34.200196 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200170 2584 factory.go:55] Registering systemd factory Sep 11 08:46:34.200196 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200181 2584 factory.go:223] Registration of the systemd container factory successfully Sep 11 08:46:34.200358 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200345 2584 factory.go:153] Registering CRI-O factory Sep 11 08:46:34.200358 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200356 2584 factory.go:223] Registration of the crio container factory successfully Sep 11 08:46:34.200486 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200395 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 08:46:34.200486 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200424 2584 factory.go:103] Registering Raw factory Sep 11 08:46:34.200486 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.200439 2584 manager.go:1196] Started watching for new ooms in manager Sep 11 08:46:34.201206 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.201190 2584 manager.go:349] Starting recovery of all containers Sep 11 08:46:34.206430 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.206348 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 08:46:34.209875 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.209855 2584 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-35.ec2.internal\" not found" node="ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.209992 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.209957 2584 manager.go:354] Recovery completed Sep 11 08:46:34.215716 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.215585 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 08:46:34.217665 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.217647 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Sep 11 08:46:34.217724 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.217683 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 08:46:34.217724 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.217699 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Sep 11 08:46:34.218224 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.218210 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 08:46:34.218224 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.218219 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 08:46:34.218346 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.218225 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 08:46:34.218346 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.218243 2584 state_mem.go:36] "Initialized new in-memory state store" Sep 11 08:46:34.219041 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.219022 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Sep 11 08:46:34.219096 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.219053 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 08:46:34.219096 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.219066 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Sep 11 08:46:34.219552 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.219539 2584 policy_none.go:49] "None policy: Start" Sep 11 08:46:34.219590 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.219559 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 08:46:34.219590 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.219573 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 08:46:34.220677 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.220661 2584 policy_none.go:47] "Start" Sep 11 08:46:34.253981 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.253966 2584 manager.go:337] "Starting Device Plugin manager" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.254012 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.254025 2584 server.go:87] "Starting device plugin registration server" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.254384 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.254398 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.254475 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.254560 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.254570 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.255203 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 08:46:34.263744 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.255254 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:34.296102 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.296059 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 08:46:34.297279 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.297257 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 08:46:34.297369 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.297309 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 08:46:34.297369 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.297337 2584 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 08:46:34.297482 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.297447 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 08:46:34.299771 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.299754 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 08:46:34.354744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.354713 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 08:46:34.355800 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.355775 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Sep 11 08:46:34.355905 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.355806 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 08:46:34.355905 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.355818 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Sep 11 08:46:34.355905 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.355845 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.365444 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.365427 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.365501 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.365454 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-35.ec2.internal\": node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:34.383938 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.383858 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:34.398285 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.398265 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal"] Sep 11 08:46:34.398384 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.398331 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 08:46:34.399328 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.399310 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Sep 11 08:46:34.399419 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.399341 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 08:46:34.399419 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.399356 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Sep 11 08:46:34.400795 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.400783 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 08:46:34.400932 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.400914 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.400994 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.400953 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 08:46:34.400994 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.400973 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30cb0c226f335d7313a21ad30a6f7cac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"30cb0c226f335d7313a21ad30a6f7cac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.401069 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.400995 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30cb0c226f335d7313a21ad30a6f7cac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"30cb0c226f335d7313a21ad30a6f7cac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.401920 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.401905 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Sep 11 08:46:34.402003 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.401929 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Sep 11 08:46:34.402003 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.401953 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 08:46:34.402003 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.401967 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Sep 11 08:46:34.402003 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.401931 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 08:46:34.402184 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.402017 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Sep 11 08:46:34.403148 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.403135 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.403194 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.403159 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 08:46:34.404149 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.404131 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientMemory" Sep 11 08:46:34.404215 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.404163 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 08:46:34.404215 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.404177 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeHasSufficientPID" Sep 11 08:46:34.432121 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.432098 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-35.ec2.internal\" not found" node="ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.436415 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.436391 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-35.ec2.internal\" not found" node="ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.484900 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.484880 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:34.501781 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.501762 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30cb0c226f335d7313a21ad30a6f7cac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"30cb0c226f335d7313a21ad30a6f7cac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.501847 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.501787 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30cb0c226f335d7313a21ad30a6f7cac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"30cb0c226f335d7313a21ad30a6f7cac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.501847 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.501807 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93df758dcc4ccadda4b591db6160bde6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-35.ec2.internal\" (UID: \"93df758dcc4ccadda4b591db6160bde6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.501920 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.501860 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/30cb0c226f335d7313a21ad30a6f7cac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"30cb0c226f335d7313a21ad30a6f7cac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.501920 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.501864 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30cb0c226f335d7313a21ad30a6f7cac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal\" (UID: \"30cb0c226f335d7313a21ad30a6f7cac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.585775 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.585753 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:34.602093 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.602075 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93df758dcc4ccadda4b591db6160bde6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-35.ec2.internal\" (UID: \"93df758dcc4ccadda4b591db6160bde6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.602148 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.602120 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/93df758dcc4ccadda4b591db6160bde6-config\") pod \"kube-apiserver-proxy-ip-10-0-138-35.ec2.internal\" (UID: \"93df758dcc4ccadda4b591db6160bde6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.686546 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.686481 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:34.735022 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.734997 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.739957 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:34.739939 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Sep 11 08:46:34.787526 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.787490 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:34.888062 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:34.888021 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:36.825013 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:36.824985 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:36.925654 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:36.925611 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-35.ec2.internal\" not found" Sep 11 08:46:36.974123 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:36.974096 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 08:46:36.975623 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:36.975593 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 08:46:36.975796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:36.975770 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 08:46:36.975856 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:36.975780 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 08:46:37.015943 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.015912 2584 apiserver.go:52] "Watching apiserver" Sep 11 08:46:37.031636 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.031605 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 08:46:37.031975 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.031952 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-rwdtp","openshift-image-registry/node-ca-srk4w","openshift-network-diagnostics/network-check-target-kgbhf","openshift-ovn-kubernetes/ovnkube-node-gxt2j","kube-system/konnectivity-agent-c7b6l","openshift-cluster-node-tuning-operator/tuned-p78x2","openshift-multus/multus-additional-cni-plugins-b7sgn","openshift-multus/multus-z47cc","openshift-multus/network-metrics-daemon-9xp5k","openshift-network-operator/iptables-alerter-h6pkf","kube-system/global-pull-secret-syncer-c2fvf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq"] Sep 11 08:46:37.033213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.033189 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.034144 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.034116 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 08:41:36 +0000 UTC" deadline="2028-02-22 17:42:36.760098067 +0000 UTC" Sep 11 08:46:37.034220 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.034144 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12704h55m59.725957314s" Sep 11 08:46:37.034500 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.034481 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.034813 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.034790 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 08:46:37.034959 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.034945 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 08:46:37.035017 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.034957 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6dk6p\"" Sep 11 08:46:37.035406 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.035392 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 08:46:37.035532 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.035517 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:37.035588 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.035571 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:37.035970 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.035955 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" Sep 11 08:46:37.036793 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.036771 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 08:46:37.036899 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.036849 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 08:46:37.037133 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.037089 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.037339 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.037316 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 08:46:37.037412 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.037394 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5j6q6\"" Sep 11 08:46:37.039342 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.039323 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:37.039342 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.039335 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 08:46:37.039918 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.039894 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-96w8j\"" Sep 11 08:46:37.039918 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.039908 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 08:46:37.040143 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.040122 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 08:46:37.040268 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.040245 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 08:46:37.040534 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.040516 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 08:46:37.040857 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.040838 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.041853 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.041601 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 08:46:37.041853 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.041655 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 08:46:37.041853 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.041722 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-shj8d\"" Sep 11 08:46:37.042111 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.041856 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 08:46:37.042111 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042092 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:37.042214 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042129 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-slash\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042214 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042157 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042214 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042186 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/759ae063-04b2-4e1c-a2af-a608761aca21-hosts-file\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.042214 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042209 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-kubelet\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042246 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-systemd\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042276 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-ovn\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042299 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-systemd-units\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042321 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-cni-bin\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042345 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjlhg\" (UniqueName: \"kubernetes.io/projected/759ae063-04b2-4e1c-a2af-a608761aca21-kube-api-access-pjlhg\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.042429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f5a742-7b52-4fb4-a027-0c19181fb247-host\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.042429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042388 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-run-netns\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042410 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-cni-netd\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042432 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovn-node-metrics-cert\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042453 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-node-log\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042483 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-env-overrides\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042509 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759ae063-04b2-4e1c-a2af-a608761aca21-tmp-dir\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042532 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkslj\" (UniqueName: \"kubernetes.io/projected/f8f5a742-7b52-4fb4-a027-0c19181fb247-kube-api-access-lkslj\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042552 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-etc-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042589 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042612 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-log-socket\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042627 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovnkube-config\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovnkube-script-lib\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042657 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67whj\" (UniqueName: \"kubernetes.io/projected/13e9b35e-dd8f-460e-b5a7-a2689386c582-kube-api-access-67whj\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.042714 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042691 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8f5a742-7b52-4fb4-a027-0c19181fb247-serviceca\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.043212 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042725 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-var-lib-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.043212 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042748 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.043212 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042873 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6hp2t\"" Sep 11 08:46:37.043212 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.042969 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 08:46:37.043212 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.043094 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.043624 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.043611 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 08:46:37.044161 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.044147 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.044772 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.044759 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 08:46:37.045473 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.045447 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:37.045696 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.045680 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 08:46:37.045696 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.045662 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:37.045839 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.045745 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j56cv\"" Sep 11 08:46:37.046123 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.046083 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 08:46:37.046123 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.046093 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 08:46:37.046362 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.046343 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 08:46:37.046428 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.046362 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 08:46:37.046925 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.046906 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x579w\"" Sep 11 08:46:37.047020 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.047005 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.047731 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.047691 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 08:46:37.048441 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.048427 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.048524 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.048497 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:37.048747 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.048730 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 08:46:37.048902 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.048733 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 08:46:37.048998 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.048983 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-99s78\"" Sep 11 08:46:37.049089 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.049074 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 08:46:37.049661 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.049646 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.051340 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.051322 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-77ttq\"" Sep 11 08:46:37.051607 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.051539 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 08:46:37.051607 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.051578 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 08:46:37.051735 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.051613 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 08:46:37.053264 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.053245 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 08:46:37.053378 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.053365 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" Sep 11 08:46:37.053479 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.053464 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal"] Sep 11 08:46:37.063311 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.063293 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal"] Sep 11 08:46:37.063394 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.063302 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 08:46:37.071326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.071303 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m2b2j" Sep 11 08:46:37.072761 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.072737 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93df758dcc4ccadda4b591db6160bde6.slice/crio-b9572de3db3becac94977fcbc19b614d3b272f450f78a58e102a052e54d304b8 WatchSource:0}: Error finding container b9572de3db3becac94977fcbc19b614d3b272f450f78a58e102a052e54d304b8: Status 404 returned error can't find the container with id b9572de3db3becac94977fcbc19b614d3b272f450f78a58e102a052e54d304b8 Sep 11 08:46:37.077477 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.077389 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 08:46:37.079771 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.079752 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m2b2j" Sep 11 08:46:37.083304 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.083280 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cb0c226f335d7313a21ad30a6f7cac.slice/crio-5eca318ffb9c7a2ff21fb601e017097e8273e7838b15f71381991e7ddc6e2021 WatchSource:0}: Error finding container 5eca318ffb9c7a2ff21fb601e017097e8273e7838b15f71381991e7ddc6e2021: Status 404 returned error can't find the container with id 5eca318ffb9c7a2ff21fb601e017097e8273e7838b15f71381991e7ddc6e2021 Sep 11 08:46:37.137143 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.137114 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 08:46:37.137289 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.137097 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" event={"ID":"30cb0c226f335d7313a21ad30a6f7cac","Type":"ContainerStarted","Data":"5eca318ffb9c7a2ff21fb601e017097e8273e7838b15f71381991e7ddc6e2021"} Sep 11 08:46:37.138132 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.138102 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" event={"ID":"93df758dcc4ccadda4b591db6160bde6","Type":"ContainerStarted","Data":"b9572de3db3becac94977fcbc19b614d3b272f450f78a58e102a052e54d304b8"} Sep 11 08:46:37.143331 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143315 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-kubelet\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.143389 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143339 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-socket-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.143389 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143358 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-kubernetes\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.143389 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143375 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.143533 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143439 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:37.143533 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143480 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.143621 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143552 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-socket-dir-parent\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.143621 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143562 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.143621 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143614 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.143756 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143633 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:37.143756 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143661 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-kubelet\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.143756 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143691 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-cni-bin\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.143756 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143726 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-cni-bin\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.143756 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143752 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-kubelet\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143756 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-modprobe-d\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143787 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysctl-d\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143804 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-cni-binary-copy\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143822 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjlhg\" (UniqueName: \"kubernetes.io/projected/759ae063-04b2-4e1c-a2af-a608761aca21-kube-api-access-pjlhg\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143836 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f5a742-7b52-4fb4-a027-0c19181fb247-host\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143851 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-cni-netd\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143865 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-etc-kubernetes\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143900 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143922 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc293d75-ebd7-422b-9685-2a75bd515b52-agent-certs\") pod \"konnectivity-agent-c7b6l\" (UID: \"cc293d75-ebd7-422b-9685-2a75bd515b52\") " pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:37.143958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143936 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8f5a742-7b52-4fb4-a027-0c19181fb247-host\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.143961 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-cni-netd\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144022 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-run\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144048 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-node-log\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144066 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-multus-certs\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144097 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-host-slash\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144115 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-node-log\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144124 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc293d75-ebd7-422b-9685-2a75bd515b52-konnectivity-ca\") pod \"konnectivity-agent-c7b6l\" (UID: \"cc293d75-ebd7-422b-9685-2a75bd515b52\") " pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144145 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysconfig\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-lib-modules\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144176 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-var-lib-kubelet\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144190 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-conf-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144203 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-dbus\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144216 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-systemd\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.144239 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144231 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-system-cni-dir\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144246 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-iptables-alerter-script\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144294 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-log-socket\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovnkube-config\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144326 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovnkube-script-lib\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67whj\" (UniqueName: \"kubernetes.io/projected/13e9b35e-dd8f-460e-b5a7-a2689386c582-kube-api-access-67whj\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144357 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-log-socket\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144372 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-cni-binary-copy\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144412 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6djt4\" (UniqueName: \"kubernetes.io/projected/72ab3382-b01b-4b9c-b82d-48f68f3bc891-kube-api-access-6djt4\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144415 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144452 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8f5a742-7b52-4fb4-a027-0c19181fb247-serviceca\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144477 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-var-lib-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144498 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-hostroot\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144537 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c9xf\" (UniqueName: \"kubernetes.io/projected/3bf7f934-d4c0-4ade-9569-164364a7dd1a-kube-api-access-6c9xf\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144548 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-var-lib-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144559 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-sys\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.144796 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144597 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-tuned\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144620 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-slash\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144634 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-device-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144653 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysctl-conf\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144691 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72ab3382-b01b-4b9c-b82d-48f68f3bc891-tmp\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144697 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-slash\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144732 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/759ae063-04b2-4e1c-a2af-a608761aca21-hosts-file\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144779 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-systemd\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144798 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-systemd\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144828 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-ovn\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144850 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-system-cni-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144899 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-netns\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144921 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-daemon-config\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144924 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/759ae063-04b2-4e1c-a2af-a608761aca21-hosts-file\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144933 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-run-ovn\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144954 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-systemd-units\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144960 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8f5a742-7b52-4fb4-a027-0c19181fb247-serviceca\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.145584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144983 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qnwr\" (UniqueName: \"kubernetes.io/projected/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-kube-api-access-2qnwr\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.144960 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovnkube-config\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145011 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-systemd-units\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145030 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-registration-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145059 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xll48\" (UniqueName: \"kubernetes.io/projected/208c8836-9e40-4532-b9f1-02b4030fc364-kube-api-access-xll48\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145085 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv2ll\" (UniqueName: \"kubernetes.io/projected/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-kube-api-access-sv2ll\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145112 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-run-netns\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145137 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovn-node-metrics-cert\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145160 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-cni-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145184 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-host\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145202 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-run-netns\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145206 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145252 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-env-overrides\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145276 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmmp8\" (UniqueName: \"kubernetes.io/projected/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-kube-api-access-nmmp8\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145300 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145323 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-sys-fs\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.146193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145441 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759ae063-04b2-4e1c-a2af-a608761aca21-tmp-dir\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145492 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkslj\" (UniqueName: \"kubernetes.io/projected/f8f5a742-7b52-4fb4-a027-0c19181fb247-kube-api-access-lkslj\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145533 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-kubelet-config\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145538 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145605 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-etc-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145620 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-env-overrides\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145620 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovnkube-script-lib\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145561 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-etc-openvswitch\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145673 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-cnibin\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145691 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-cnibin\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145717 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145736 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-k8s-cni-cncf-io\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145741 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759ae063-04b2-4e1c-a2af-a608761aca21-tmp-dir\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-cni-bin\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145766 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-cni-multus\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.146670 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.145778 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13e9b35e-dd8f-460e-b5a7-a2689386c582-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.148697 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.148681 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13e9b35e-dd8f-460e-b5a7-a2689386c582-ovn-node-metrics-cert\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.152760 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.152743 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 08:46:37.152825 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.152763 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 08:46:37.152825 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.152773 2584 projected.go:196] Error preparing data for projected volume kube-api-access-k6lcx for pod openshift-network-diagnostics/network-check-target-kgbhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:37.152825 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.152824 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx podName:c67f45da-f058-4d7c-91ad-486492813cb1 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:37.652806279 +0000 UTC m=+1.980183214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k6lcx" (UniqueName: "kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx") pod "network-check-target-kgbhf" (UID: "c67f45da-f058-4d7c-91ad-486492813cb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:37.156168 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.156132 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkslj\" (UniqueName: \"kubernetes.io/projected/f8f5a742-7b52-4fb4-a027-0c19181fb247-kube-api-access-lkslj\") pod \"node-ca-srk4w\" (UID: \"f8f5a742-7b52-4fb4-a027-0c19181fb247\") " pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.156258 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.156181 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67whj\" (UniqueName: \"kubernetes.io/projected/13e9b35e-dd8f-460e-b5a7-a2689386c582-kube-api-access-67whj\") pod \"ovnkube-node-gxt2j\" (UID: \"13e9b35e-dd8f-460e-b5a7-a2689386c582\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.156258 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.156209 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjlhg\" (UniqueName: \"kubernetes.io/projected/759ae063-04b2-4e1c-a2af-a608761aca21-kube-api-access-pjlhg\") pod \"node-resolver-rwdtp\" (UID: \"759ae063-04b2-4e1c-a2af-a608761aca21\") " pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.246216 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246190 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-system-cni-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.246216 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246217 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-netns\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.246439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246233 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-daemon-config\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.246439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246261 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qnwr\" (UniqueName: \"kubernetes.io/projected/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-kube-api-access-2qnwr\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.246439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246277 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-registration-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.246439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246300 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xll48\" (UniqueName: \"kubernetes.io/projected/208c8836-9e40-4532-b9f1-02b4030fc364-kube-api-access-xll48\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.246439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246335 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv2ll\" (UniqueName: \"kubernetes.io/projected/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-kube-api-access-sv2ll\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:37.246439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246360 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-cni-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.246439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246387 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-system-cni-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.246439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-host\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.246782 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246450 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-registration-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.246909 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246866 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-netns\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.246909 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246893 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-host\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.247026 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246722 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.247026 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.246962 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmmp8\" (UniqueName: \"kubernetes.io/projected/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-kube-api-access-nmmp8\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.247026 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247009 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.247195 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247167 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-sys-fs\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.247280 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247264 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-cni-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.247366 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247343 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-daemon-config\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.247462 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247441 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-sys-fs\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.247562 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247499 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.247653 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247629 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.247757 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247737 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-kubelet-config\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.247842 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247730 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.247842 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247790 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-cnibin\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.247842 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247795 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-kubelet-config\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.247842 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247824 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-cnibin\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247899 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-k8s-cni-cncf-io\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247929 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-cni-bin\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247939 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-cnibin\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247961 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-cni-multus\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247966 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-cnibin\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.247975 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248006 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-k8s-cni-cncf-io\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248025 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-cni-bin\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248048 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248044 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-cni-multus\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248083 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-kubelet\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248114 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-socket-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248145 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-kubernetes\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248177 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-kubernetes\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248149 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-var-lib-kubelet\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248175 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248246 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-socket-dir-parent\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248270 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-socket-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248310 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248378 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-socket-dir-parent\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.248427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248379 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248452 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248433 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-modprobe-d\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.248466 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248510 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysctl-d\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.248539 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs podName:88ce320d-1c5f-4f87-9cbd-0cee5cb7c076 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:37.748520556 +0000 UTC m=+2.075897495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs") pod "network-metrics-daemon-9xp5k" (UID: "88ce320d-1c5f-4f87-9cbd-0cee5cb7c076") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248565 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-cni-binary-copy\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248580 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-modprobe-d\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248620 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-etc-kubernetes\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248647 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248698 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc293d75-ebd7-422b-9685-2a75bd515b52-agent-certs\") pod \"konnectivity-agent-c7b6l\" (UID: \"cc293d75-ebd7-422b-9685-2a75bd515b52\") " pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-run\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248665 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysctl-d\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248829 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-multus-certs\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248859 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-host-slash\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248909 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-etc-kubernetes\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248949 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc293d75-ebd7-422b-9685-2a75bd515b52-konnectivity-ca\") pod \"konnectivity-agent-c7b6l\" (UID: \"cc293d75-ebd7-422b-9685-2a75bd515b52\") " pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.248975 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:37.249043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248977 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-host-run-multus-certs\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.248982 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysconfig\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249012 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-lib-modules\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.249034 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret podName:5bd3198a-fe39-49bd-bce0-fc4930f5a1b5 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:37.749014957 +0000 UTC m=+2.076391891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret") pod "global-pull-secret-syncer-c2fvf" (UID: "5bd3198a-fe39-49bd-bce0-fc4930f5a1b5") : object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249068 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-var-lib-kubelet\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249092 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-conf-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249126 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-dbus\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249128 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-lib-modules\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249159 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-systemd\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249221 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-systemd\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249230 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/208c8836-9e40-4532-b9f1-02b4030fc364-cni-binary-copy\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249302 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-multus-conf-dir\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249443 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-host-slash\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249510 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysconfig\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249548 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-system-cni-dir\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249583 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-iptables-alerter-script\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249622 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-cni-binary-copy\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.249869 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249655 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6djt4\" (UniqueName: \"kubernetes.io/projected/72ab3382-b01b-4b9c-b82d-48f68f3bc891-kube-api-access-6djt4\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249689 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-hostroot\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249717 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c9xf\" (UniqueName: \"kubernetes.io/projected/3bf7f934-d4c0-4ade-9569-164364a7dd1a-kube-api-access-6c9xf\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249747 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-sys\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249778 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-tuned\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249795 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cc293d75-ebd7-422b-9685-2a75bd515b52-konnectivity-ca\") pod \"konnectivity-agent-c7b6l\" (UID: \"cc293d75-ebd7-422b-9685-2a75bd515b52\") " pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249812 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-device-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249843 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysctl-conf\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.249869 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72ab3382-b01b-4b9c-b82d-48f68f3bc891-tmp\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.250176 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-run\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.250243 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-dbus\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.250300 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-var-lib-kubelet\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.250364 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/208c8836-9e40-4532-b9f1-02b4030fc364-system-cni-dir\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.250684 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.250528 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-hostroot\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.251229 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.250741 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-sys\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.251229 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.250820 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bf7f934-d4c0-4ade-9569-164364a7dd1a-device-dir\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.251229 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.250907 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-sysctl-conf\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.251536 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.251508 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-cni-binary-copy\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.251678 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.251637 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-iptables-alerter-script\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.252772 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.252743 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72ab3382-b01b-4b9c-b82d-48f68f3bc891-tmp\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.252908 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.252891 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cc293d75-ebd7-422b-9685-2a75bd515b52-agent-certs\") pod \"konnectivity-agent-c7b6l\" (UID: \"cc293d75-ebd7-422b-9685-2a75bd515b52\") " pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:37.252964 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.252894 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/72ab3382-b01b-4b9c-b82d-48f68f3bc891-etc-tuned\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.255180 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.255151 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xll48\" (UniqueName: \"kubernetes.io/projected/208c8836-9e40-4532-b9f1-02b4030fc364-kube-api-access-xll48\") pod \"multus-additional-cni-plugins-b7sgn\" (UID: \"208c8836-9e40-4532-b9f1-02b4030fc364\") " pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.255446 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.255418 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qnwr\" (UniqueName: \"kubernetes.io/projected/6322f7ae-8caf-45a0-b3b0-4d64b07ce669-kube-api-access-2qnwr\") pod \"iptables-alerter-h6pkf\" (UID: \"6322f7ae-8caf-45a0-b3b0-4d64b07ce669\") " pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.255520 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.255441 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmmp8\" (UniqueName: \"kubernetes.io/projected/3f0ec46f-ab10-4683-9f40-5f7c1250f02e-kube-api-access-nmmp8\") pod \"multus-z47cc\" (UID: \"3f0ec46f-ab10-4683-9f40-5f7c1250f02e\") " pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.255725 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.255707 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv2ll\" (UniqueName: \"kubernetes.io/projected/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-kube-api-access-sv2ll\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:37.259055 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.259030 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6djt4\" (UniqueName: \"kubernetes.io/projected/72ab3382-b01b-4b9c-b82d-48f68f3bc891-kube-api-access-6djt4\") pod \"tuned-p78x2\" (UID: \"72ab3382-b01b-4b9c-b82d-48f68f3bc891\") " pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.259135 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.259061 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c9xf\" (UniqueName: \"kubernetes.io/projected/3bf7f934-d4c0-4ade-9569-164364a7dd1a-kube-api-access-6c9xf\") pod \"aws-ebs-csi-driver-node-7zlzq\" (UID: \"3bf7f934-d4c0-4ade-9569-164364a7dd1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.357569 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.357485 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rwdtp" Sep 11 08:46:37.366211 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.366185 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759ae063_04b2_4e1c_a2af_a608761aca21.slice/crio-5096c316de51e3814ad266b9bcc9637e025a79f7d9a6657600c20dcf885420fb WatchSource:0}: Error finding container 5096c316de51e3814ad266b9bcc9637e025a79f7d9a6657600c20dcf885420fb: Status 404 returned error can't find the container with id 5096c316de51e3814ad266b9bcc9637e025a79f7d9a6657600c20dcf885420fb Sep 11 08:46:37.374940 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.374920 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-srk4w" Sep 11 08:46:37.381693 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.381659 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f5a742_7b52_4fb4_a027_0c19181fb247.slice/crio-ce71b8a6b0e283cafd018921830520549cb9a03d27423b86008a5ef79698901b WatchSource:0}: Error finding container ce71b8a6b0e283cafd018921830520549cb9a03d27423b86008a5ef79698901b: Status 404 returned error can't find the container with id ce71b8a6b0e283cafd018921830520549cb9a03d27423b86008a5ef79698901b Sep 11 08:46:37.382383 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.382366 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:46:37.389024 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.389005 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:37.389393 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.389369 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e9b35e_dd8f_460e_b5a7_a2689386c582.slice/crio-ba62b6f6852c62d2f39dcac573bff0cb30cffbcd50b91ae1d4bf0c29146a0dbc WatchSource:0}: Error finding container ba62b6f6852c62d2f39dcac573bff0cb30cffbcd50b91ae1d4bf0c29146a0dbc: Status 404 returned error can't find the container with id ba62b6f6852c62d2f39dcac573bff0cb30cffbcd50b91ae1d4bf0c29146a0dbc Sep 11 08:46:37.391765 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.391744 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 08:46:37.394086 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.394069 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p78x2" Sep 11 08:46:37.397161 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.397132 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc293d75_ebd7_422b_9685_2a75bd515b52.slice/crio-a22b2af4335167c25480583dde348217b8d5b7c4aa07d22df07b7bc70394c7dd WatchSource:0}: Error finding container a22b2af4335167c25480583dde348217b8d5b7c4aa07d22df07b7bc70394c7dd: Status 404 returned error can't find the container with id a22b2af4335167c25480583dde348217b8d5b7c4aa07d22df07b7bc70394c7dd Sep 11 08:46:37.399296 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.399279 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" Sep 11 08:46:37.402682 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.402450 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ab3382_b01b_4b9c_b82d_48f68f3bc891.slice/crio-a5447b40630c6c2e434d420b72559d14bbe23d0450f6817898ef3e56d87d20b8 WatchSource:0}: Error finding container a5447b40630c6c2e434d420b72559d14bbe23d0450f6817898ef3e56d87d20b8: Status 404 returned error can't find the container with id a5447b40630c6c2e434d420b72559d14bbe23d0450f6817898ef3e56d87d20b8 Sep 11 08:46:37.404862 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.404842 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z47cc" Sep 11 08:46:37.406769 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.406750 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208c8836_9e40_4532_b9f1_02b4030fc364.slice/crio-82dc5c4ee3891b6c2b6b274ec74eec4d9ecb5141746db3f5686fed64e387f2e1 WatchSource:0}: Error finding container 82dc5c4ee3891b6c2b6b274ec74eec4d9ecb5141746db3f5686fed64e387f2e1: Status 404 returned error can't find the container with id 82dc5c4ee3891b6c2b6b274ec74eec4d9ecb5141746db3f5686fed64e387f2e1 Sep 11 08:46:37.411857 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.411837 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h6pkf" Sep 11 08:46:37.413032 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.413010 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0ec46f_ab10_4683_9f40_5f7c1250f02e.slice/crio-5ef46b3d232a737c131f77dde5ed7445fb64f675b7cef69e246ff25b060b2383 WatchSource:0}: Error finding container 5ef46b3d232a737c131f77dde5ed7445fb64f675b7cef69e246ff25b060b2383: Status 404 returned error can't find the container with id 5ef46b3d232a737c131f77dde5ed7445fb64f675b7cef69e246ff25b060b2383 Sep 11 08:46:37.416076 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.416059 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" Sep 11 08:46:37.418870 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.418844 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6322f7ae_8caf_45a0_b3b0_4d64b07ce669.slice/crio-379696fcd00e345ae2826f7cd34907984274e423c0bcb987c47a466638fee438 WatchSource:0}: Error finding container 379696fcd00e345ae2826f7cd34907984274e423c0bcb987c47a466638fee438: Status 404 returned error can't find the container with id 379696fcd00e345ae2826f7cd34907984274e423c0bcb987c47a466638fee438 Sep 11 08:46:37.423415 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:46:37.423391 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf7f934_d4c0_4ade_9569_164364a7dd1a.slice/crio-e124e9655610d5aa72f88406a68fadd8c4c51d69e72146ab82224ddfd24c4e12 WatchSource:0}: Error finding container e124e9655610d5aa72f88406a68fadd8c4c51d69e72146ab82224ddfd24c4e12: Status 404 returned error can't find the container with id e124e9655610d5aa72f88406a68fadd8c4c51d69e72146ab82224ddfd24c4e12 Sep 11 08:46:37.653544 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.653466 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:37.653696 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.653656 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 08:46:37.653696 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.653682 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 08:46:37.653696 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.653696 2584 projected.go:196] Error preparing data for projected volume kube-api-access-k6lcx for pod openshift-network-diagnostics/network-check-target-kgbhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:37.653864 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.653759 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx podName:c67f45da-f058-4d7c-91ad-486492813cb1 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:38.653740504 +0000 UTC m=+2.981117435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6lcx" (UniqueName: "kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx") pod "network-check-target-kgbhf" (UID: "c67f45da-f058-4d7c-91ad-486492813cb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:37.755915 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.755063 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:37.755915 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:37.755188 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:37.755915 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.755467 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:37.755915 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.755539 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret podName:5bd3198a-fe39-49bd-bce0-fc4930f5a1b5 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:38.755518802 +0000 UTC m=+3.082895724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret") pod "global-pull-secret-syncer-c2fvf" (UID: "5bd3198a-fe39-49bd-bce0-fc4930f5a1b5") : object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:37.756404 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.756300 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:37.756404 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:37.756378 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs podName:88ce320d-1c5f-4f87-9cbd-0cee5cb7c076 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:38.756362189 +0000 UTC m=+3.083739121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs") pod "network-metrics-daemon-9xp5k" (UID: "88ce320d-1c5f-4f87-9cbd-0cee5cb7c076") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:38.082283 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.082165 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 08:41:37 +0000 UTC" deadline="2028-05-01 09:43:23.019215384 +0000 UTC" Sep 11 08:46:38.082283 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.082244 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14352h56m44.936987597s" Sep 11 08:46:38.152101 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.152061 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" event={"ID":"3bf7f934-d4c0-4ade-9569-164364a7dd1a","Type":"ContainerStarted","Data":"e124e9655610d5aa72f88406a68fadd8c4c51d69e72146ab82224ddfd24c4e12"} Sep 11 08:46:38.178137 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.178100 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h6pkf" event={"ID":"6322f7ae-8caf-45a0-b3b0-4d64b07ce669","Type":"ContainerStarted","Data":"379696fcd00e345ae2826f7cd34907984274e423c0bcb987c47a466638fee438"} Sep 11 08:46:38.183743 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.183709 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p78x2" event={"ID":"72ab3382-b01b-4b9c-b82d-48f68f3bc891","Type":"ContainerStarted","Data":"a5447b40630c6c2e434d420b72559d14bbe23d0450f6817898ef3e56d87d20b8"} Sep 11 08:46:38.208084 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.208048 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c7b6l" event={"ID":"cc293d75-ebd7-422b-9685-2a75bd515b52","Type":"ContainerStarted","Data":"a22b2af4335167c25480583dde348217b8d5b7c4aa07d22df07b7bc70394c7dd"} Sep 11 08:46:38.223662 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.223627 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-srk4w" event={"ID":"f8f5a742-7b52-4fb4-a027-0c19181fb247","Type":"ContainerStarted","Data":"ce71b8a6b0e283cafd018921830520549cb9a03d27423b86008a5ef79698901b"} Sep 11 08:46:38.233962 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.233929 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rwdtp" event={"ID":"759ae063-04b2-4e1c-a2af-a608761aca21","Type":"ContainerStarted","Data":"5096c316de51e3814ad266b9bcc9637e025a79f7d9a6657600c20dcf885420fb"} Sep 11 08:46:38.250867 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.250716 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z47cc" event={"ID":"3f0ec46f-ab10-4683-9f40-5f7c1250f02e","Type":"ContainerStarted","Data":"5ef46b3d232a737c131f77dde5ed7445fb64f675b7cef69e246ff25b060b2383"} Sep 11 08:46:38.268935 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.268896 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" event={"ID":"208c8836-9e40-4532-b9f1-02b4030fc364","Type":"ContainerStarted","Data":"82dc5c4ee3891b6c2b6b274ec74eec4d9ecb5141746db3f5686fed64e387f2e1"} Sep 11 08:46:38.282243 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.282210 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"ba62b6f6852c62d2f39dcac573bff0cb30cffbcd50b91ae1d4bf0c29146a0dbc"} Sep 11 08:46:38.533572 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.533496 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 08:46:38.548833 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.548799 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 08:46:38.665522 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.665488 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:38.665701 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:38.665679 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 08:46:38.665781 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:38.665711 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 08:46:38.665781 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:38.665725 2584 projected.go:196] Error preparing data for projected volume kube-api-access-k6lcx for pod openshift-network-diagnostics/network-check-target-kgbhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:38.665897 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:38.665789 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx podName:c67f45da-f058-4d7c-91ad-486492813cb1 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:40.665770892 +0000 UTC m=+4.993147812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6lcx" (UniqueName: "kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx") pod "network-check-target-kgbhf" (UID: "c67f45da-f058-4d7c-91ad-486492813cb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:38.766524 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.766491 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:38.766685 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:38.766545 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:38.766761 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:38.766683 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:38.766761 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:38.766751 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret podName:5bd3198a-fe39-49bd-bce0-fc4930f5a1b5 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:40.766731153 +0000 UTC m=+5.094108073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret") pod "global-pull-secret-syncer-c2fvf" (UID: "5bd3198a-fe39-49bd-bce0-fc4930f5a1b5") : object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:38.767195 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:38.767174 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:38.767285 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:38.767234 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs podName:88ce320d-1c5f-4f87-9cbd-0cee5cb7c076 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:40.767218199 +0000 UTC m=+5.094595119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs") pod "network-metrics-daemon-9xp5k" (UID: "88ce320d-1c5f-4f87-9cbd-0cee5cb7c076") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:39.082958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:39.082826 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 08:41:37 +0000 UTC" deadline="2028-06-21 00:09:46.399811508 +0000 UTC" Sep 11 08:46:39.082958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:39.082866 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15567h23m7.316950789s" Sep 11 08:46:39.135909 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:39.135021 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:39.135909 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:39.135164 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:39.135909 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:39.135578 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:39.135909 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:39.135672 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:39.135909 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:39.135732 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:39.135909 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:39.135804 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:40.683272 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:40.683182 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:40.683694 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:40.683384 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 08:46:40.683694 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:40.683402 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 08:46:40.683694 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:40.683414 2584 projected.go:196] Error preparing data for projected volume kube-api-access-k6lcx for pod openshift-network-diagnostics/network-check-target-kgbhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:40.683694 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:40.683471 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx podName:c67f45da-f058-4d7c-91ad-486492813cb1 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:44.68345334 +0000 UTC m=+9.010830263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6lcx" (UniqueName: "kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx") pod "network-check-target-kgbhf" (UID: "c67f45da-f058-4d7c-91ad-486492813cb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:40.783858 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:40.783818 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:40.784047 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:40.783939 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:40.784110 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:40.784053 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:40.784110 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:40.784107 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs podName:88ce320d-1c5f-4f87-9cbd-0cee5cb7c076 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:44.784092527 +0000 UTC m=+9.111469444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs") pod "network-metrics-daemon-9xp5k" (UID: "88ce320d-1c5f-4f87-9cbd-0cee5cb7c076") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:40.784453 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:40.784439 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:40.784528 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:40.784489 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret podName:5bd3198a-fe39-49bd-bce0-fc4930f5a1b5 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:44.784472828 +0000 UTC m=+9.111849765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret") pod "global-pull-secret-syncer-c2fvf" (UID: "5bd3198a-fe39-49bd-bce0-fc4930f5a1b5") : object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:41.135558 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:41.135034 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:41.135558 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:41.135173 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:41.135558 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:41.135198 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:41.135558 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:41.135201 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:41.135558 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:41.135295 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:41.135558 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:41.135376 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:43.134214 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:43.134182 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:43.134650 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:43.134322 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:43.134720 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:43.134688 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:43.134822 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:43.134796 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:43.134897 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:43.134849 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:43.134967 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:43.134940 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:44.715692 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:44.715140 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:44.715692 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:44.715321 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 08:46:44.715692 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:44.715341 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 08:46:44.715692 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:44.715354 2584 projected.go:196] Error preparing data for projected volume kube-api-access-k6lcx for pod openshift-network-diagnostics/network-check-target-kgbhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:44.715692 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:44.715417 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx podName:c67f45da-f058-4d7c-91ad-486492813cb1 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:52.715397798 +0000 UTC m=+17.042774732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6lcx" (UniqueName: "kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx") pod "network-check-target-kgbhf" (UID: "c67f45da-f058-4d7c-91ad-486492813cb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:44.816385 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:44.816349 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:44.816546 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:44.816403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:44.816546 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:44.816528 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:44.816662 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:44.816589 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret podName:5bd3198a-fe39-49bd-bce0-fc4930f5a1b5 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:52.816576103 +0000 UTC m=+17.143953020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret") pod "global-pull-secret-syncer-c2fvf" (UID: "5bd3198a-fe39-49bd-bce0-fc4930f5a1b5") : object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:44.816662 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:44.816528 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:44.816662 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:44.816659 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs podName:88ce320d-1c5f-4f87-9cbd-0cee5cb7c076 nodeName:}" failed. No retries permitted until 2026-09-11 08:46:52.816644186 +0000 UTC m=+17.144021117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs") pod "network-metrics-daemon-9xp5k" (UID: "88ce320d-1c5f-4f87-9cbd-0cee5cb7c076") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:45.134806 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:45.134596 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:45.134806 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:45.134775 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:45.135226 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:45.135118 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:45.135226 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:45.135217 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:45.135396 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:45.135249 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:45.135396 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:45.135329 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:47.134810 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:47.134761 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:47.134810 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:47.134802 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:47.135429 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:47.134813 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:47.135429 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:47.134916 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:47.135429 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:47.135034 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:47.135429 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:47.135154 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:49.134868 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:49.134833 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:49.135303 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:49.134871 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:49.135303 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:49.134967 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:49.135303 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:49.135037 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:49.135303 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:49.135088 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:49.135303 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:49.135153 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:51.135043 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:51.135010 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:51.135523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:51.135010 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:51.135523 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:51.135130 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:51.135523 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:51.135204 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:51.135523 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:51.135010 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:51.135523 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:51.135315 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:52.778510 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:52.778478 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:52.778967 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:52.778639 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 08:46:52.778967 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:52.778659 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 08:46:52.778967 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:52.778668 2584 projected.go:196] Error preparing data for projected volume kube-api-access-k6lcx for pod openshift-network-diagnostics/network-check-target-kgbhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:52.778967 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:52.778717 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx podName:c67f45da-f058-4d7c-91ad-486492813cb1 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:08.778702048 +0000 UTC m=+33.106078970 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6lcx" (UniqueName: "kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx") pod "network-check-target-kgbhf" (UID: "c67f45da-f058-4d7c-91ad-486492813cb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:46:52.879037 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:52.879004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:52.879037 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:52.879044 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:52.879243 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:52.879166 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:52.879243 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:52.879173 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:52.879243 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:52.879223 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret podName:5bd3198a-fe39-49bd-bce0-fc4930f5a1b5 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:08.879206976 +0000 UTC m=+33.206583914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret") pod "global-pull-secret-syncer-c2fvf" (UID: "5bd3198a-fe39-49bd-bce0-fc4930f5a1b5") : object "kube-system"/"original-pull-secret" not registered Sep 11 08:46:52.879420 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:52.879246 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs podName:88ce320d-1c5f-4f87-9cbd-0cee5cb7c076 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:08.879234658 +0000 UTC m=+33.206611581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs") pod "network-metrics-daemon-9xp5k" (UID: "88ce320d-1c5f-4f87-9cbd-0cee5cb7c076") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:46:53.135082 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:53.134987 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:53.135082 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:53.134987 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:53.135303 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:53.135139 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:53.135303 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:53.135151 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:53.135303 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:53.135243 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:53.135449 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:53.135329 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:55.134732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:55.134691 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:55.135271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:55.134738 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:55.135271 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:55.134738 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:55.135271 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:55.134821 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:55.135271 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:55.134916 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:55.135271 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:55.134994 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:56.321104 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:56.320936 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" event={"ID":"93df758dcc4ccadda4b591db6160bde6","Type":"ContainerStarted","Data":"e9afc1aba7a3ac5fe0c17290108a435d0ae27625419dca96a02a9e5e018ec7eb"} Sep 11 08:46:56.322438 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:56.322416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p78x2" event={"ID":"72ab3382-b01b-4b9c-b82d-48f68f3bc891","Type":"ContainerStarted","Data":"20a6ec2bde36e44b7b7e387828a535791434940b79734be614bfeea8224d7260"} Sep 11 08:46:56.325436 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:56.325411 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"b837817db5a4b25a3e85760f78c1d3b5cfcafab33e3575c5a98f44cbc5e9a6ea"} Sep 11 08:46:56.325503 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:56.325478 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"30e8834e6e13d789805fab94af1203f42ac44c05169a3f11ec0e02e2504e19cc"} Sep 11 08:46:56.325540 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:56.325508 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"353fe940d25ce7c5f3cd5bb8b9d8f05177bd1e99dd8ab4fa2933c1ac1549382a"} Sep 11 08:46:56.344033 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:56.343991 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p78x2" podStartSLOduration=1.9513649910000002 podStartE2EDuration="20.343977983s" totalImagesPullingTime="18.392612992s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:56.343579296 +0000 UTC m=+20.670956234" watchObservedRunningTime="2026-09-11 08:46:56.343977983 +0000 UTC m=+20.671354921" Sep 11 08:46:56.356738 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:56.356688 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-35.ec2.internal" podStartSLOduration=19.356672177 podStartE2EDuration="19.356672177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:56.356304681 +0000 UTC m=+20.683681619" watchObservedRunningTime="2026-09-11 08:46:56.356672177 +0000 UTC m=+20.684049116" Sep 11 08:46:57.135209 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.134979 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:57.135362 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.135040 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:57.135362 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:57.135269 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:57.135362 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.135044 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:57.135526 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:57.135369 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:57.135526 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:57.135442 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:57.329336 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.329291 2584 generic.go:356] "Generic (PLEG): container finished" podID="30cb0c226f335d7313a21ad30a6f7cac" containerID="96c8d9977e7941f666e24c72233ee68586dd1172c81ec00b13f6c0eb11c29ad3" exitCode=0 Sep 11 08:46:57.330059 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.329429 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" event={"ID":"30cb0c226f335d7313a21ad30a6f7cac","Type":"ContainerDied","Data":"96c8d9977e7941f666e24c72233ee68586dd1172c81ec00b13f6c0eb11c29ad3"} Sep 11 08:46:57.331282 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.331250 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" event={"ID":"3bf7f934-d4c0-4ade-9569-164364a7dd1a","Type":"ContainerStarted","Data":"612c5110fb02090d9df903e6d8c04e2c3c075a74fabee957894bfba89835efce"} Sep 11 08:46:57.333563 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.333537 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h6pkf" event={"ID":"6322f7ae-8caf-45a0-b3b0-4d64b07ce669","Type":"ContainerStarted","Data":"15702a4b77f3a28a228bce48e4f2bc63d26431634f51b94a66e84da74bee8ec5"} Sep 11 08:46:57.335261 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.335230 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c7b6l" event={"ID":"cc293d75-ebd7-422b-9685-2a75bd515b52","Type":"ContainerStarted","Data":"22d0e2393453a2f8b6225b1917ce829dbb65d6f2b5b710db7f78024d6b3d75d0"} Sep 11 08:46:57.339693 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.339665 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-srk4w" event={"ID":"f8f5a742-7b52-4fb4-a027-0c19181fb247","Type":"ContainerStarted","Data":"dd107e3404c4afaea5062bf75ef0d16646c6c95f41ddaa19f0ab5386fc2b6a38"} Sep 11 08:46:57.341320 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.341293 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rwdtp" event={"ID":"759ae063-04b2-4e1c-a2af-a608761aca21","Type":"ContainerStarted","Data":"21bacabd7cf3f16ae8f1c2af5e054112f6aafc1c322391ec6305d3a30ae9f232"} Sep 11 08:46:57.343119 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.343092 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z47cc" event={"ID":"3f0ec46f-ab10-4683-9f40-5f7c1250f02e","Type":"ContainerStarted","Data":"4af37c671aec91d899a3f98b24533a7cdbdbb7d1c26bf197f1b0f8c752af6884"} Sep 11 08:46:57.346901 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.346865 2584 generic.go:356] "Generic (PLEG): container finished" podID="208c8836-9e40-4532-b9f1-02b4030fc364" containerID="5f0ee8bab43c8ed40d50741ffe9d738c31b651e17596ce966cf928a9a183a532" exitCode=0 Sep 11 08:46:57.346984 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.346905 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" event={"ID":"208c8836-9e40-4532-b9f1-02b4030fc364","Type":"ContainerDied","Data":"5f0ee8bab43c8ed40d50741ffe9d738c31b651e17596ce966cf928a9a183a532"} Sep 11 08:46:57.350189 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.350171 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 08:46:57.350483 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.350467 2584 generic.go:356] "Generic (PLEG): container finished" podID="13e9b35e-dd8f-460e-b5a7-a2689386c582" containerID="30e8834e6e13d789805fab94af1203f42ac44c05169a3f11ec0e02e2504e19cc" exitCode=1 Sep 11 08:46:57.350550 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.350536 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerDied","Data":"30e8834e6e13d789805fab94af1203f42ac44c05169a3f11ec0e02e2504e19cc"} Sep 11 08:46:57.350620 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.350607 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"f368a839f7abd6a3af90e1da33f8047800857daa76314e6b6894ce9bdda40b29"} Sep 11 08:46:57.350673 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.350661 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"6227c87b7daa715fb1c007168db3f64802a796e1ae40bcdcbc83169221555145"} Sep 11 08:46:57.350727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.350715 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"e22a44f45004d6a255ab2fd8e001571518e784149a03ba3c9a7debb32725c406"} Sep 11 08:46:57.372782 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.372742 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h6pkf" podStartSLOduration=3.03967844 podStartE2EDuration="21.372730292s" totalImagesPullingTime="18.333051852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:57.372229331 +0000 UTC m=+21.699606270" watchObservedRunningTime="2026-09-11 08:46:57.372730292 +0000 UTC m=+21.700107275" Sep 11 08:46:57.416903 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.416181 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-srk4w" podStartSLOduration=3.045373691 podStartE2EDuration="21.416160337s" totalImagesPullingTime="18.370786646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:57.400508567 +0000 UTC m=+21.727885507" watchObservedRunningTime="2026-09-11 08:46:57.416160337 +0000 UTC m=+21.743537278" Sep 11 08:46:57.438402 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.438361 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c7b6l" podStartSLOduration=3.044989459 podStartE2EDuration="21.438342684s" totalImagesPullingTime="18.393353225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:57.417004607 +0000 UTC m=+21.744381546" watchObservedRunningTime="2026-09-11 08:46:57.438342684 +0000 UTC m=+21.765719625" Sep 11 08:46:57.457720 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.457683 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rwdtp" podStartSLOduration=3.028461417 podStartE2EDuration="21.457670454s" totalImagesPullingTime="18.429209037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:57.43811878 +0000 UTC m=+21.765495720" watchObservedRunningTime="2026-09-11 08:46:57.457670454 +0000 UTC m=+21.785047394" Sep 11 08:46:57.458126 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.458100 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z47cc" podStartSLOduration=2.448388602 podStartE2EDuration="21.458094011s" totalImagesPullingTime="19.009705409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:57.457567878 +0000 UTC m=+21.784944818" watchObservedRunningTime="2026-09-11 08:46:57.458094011 +0000 UTC m=+21.785470980" Sep 11 08:46:57.480300 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:57.480276 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 08:46:58.103378 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.103259 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T08:46:57.480293112Z","UUID":"51a567bf-6c10-4cc6-a482-8f6d878f55cf","Handler":null,"Name":"","Endpoint":""} Sep 11 08:46:58.105114 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.104913 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 08:46:58.105114 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.104955 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 08:46:58.270147 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.269849 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:58.270636 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.270615 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:58.355937 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.355849 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" event={"ID":"30cb0c226f335d7313a21ad30a6f7cac","Type":"ContainerStarted","Data":"822237e0dd938443e0dc54a4e9ff93a61b3ed6d8637c4e62a9e100e031e12099"} Sep 11 08:46:58.359021 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.358531 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" event={"ID":"3bf7f934-d4c0-4ade-9569-164364a7dd1a","Type":"ContainerStarted","Data":"fd2d3201266e5b4278f7250eccfad5d8fb47cd91274173693b51281c0a65e2ac"} Sep 11 08:46:58.359408 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.359381 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:58.359985 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.359966 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c7b6l" Sep 11 08:46:58.370588 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:58.370541 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-35.ec2.internal" podStartSLOduration=21.37052162 podStartE2EDuration="21.37052162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:58.370364117 +0000 UTC m=+22.697741062" watchObservedRunningTime="2026-09-11 08:46:58.37052162 +0000 UTC m=+22.697898560" Sep 11 08:46:59.134070 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:59.134047 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:46:59.134240 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:59.134052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:46:59.134240 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:59.134142 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:46:59.134240 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:59.134215 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:46:59.134240 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:59.134052 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:46:59.134423 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:46:59.134339 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:46:59.367608 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:59.367580 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 08:46:59.368077 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:59.368052 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"47732d1ee13131786fb6473161bd348dc7d9ab29063f2565019f64238b5256a4"} Sep 11 08:46:59.370593 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:59.370566 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" event={"ID":"3bf7f934-d4c0-4ade-9569-164364a7dd1a","Type":"ContainerStarted","Data":"c4baca597fb78c97f6a559e86d4f934a1a7cfd078da0e48aa89ffa56a2e60c56"} Sep 11 08:46:59.387903 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:46:59.387805 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7zlzq" podStartSLOduration=3.431621527 podStartE2EDuration="23.387792017s" totalImagesPullingTime="19.95617049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:46:59.387164779 +0000 UTC m=+23.714541720" watchObservedRunningTime="2026-09-11 08:46:59.387792017 +0000 UTC m=+23.715168955" Sep 11 08:47:01.135077 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:01.134992 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:01.135077 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:01.135030 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:01.135560 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:01.135118 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:47:01.135560 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:01.135145 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:47:01.135560 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:01.135211 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:01.135560 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:01.135321 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:47:02.378340 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.378172 2584 generic.go:356] "Generic (PLEG): container finished" podID="208c8836-9e40-4532-b9f1-02b4030fc364" containerID="953f4d3509dd850f5e78bc86e224f1070ff77bdd453a5cc705c76d0d950a091f" exitCode=0 Sep 11 08:47:02.378672 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.378253 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" event={"ID":"208c8836-9e40-4532-b9f1-02b4030fc364","Type":"ContainerDied","Data":"953f4d3509dd850f5e78bc86e224f1070ff77bdd453a5cc705c76d0d950a091f"} Sep 11 08:47:02.382038 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.382022 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 08:47:02.382412 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.382389 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"a140338bba8e9d2f884bd79ffce960dd6249110b0476f13bab8435ff3e3ef4a3"} Sep 11 08:47:02.382688 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.382669 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:47:02.382788 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.382724 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:47:02.382874 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.382853 2584 scope.go:117] "RemoveContainer" containerID="30e8834e6e13d789805fab94af1203f42ac44c05169a3f11ec0e02e2504e19cc" Sep 11 08:47:02.398149 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.398127 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:47:02.398313 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:02.398295 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:47:03.136372 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.136329 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:03.136554 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:03.136488 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:47:03.136945 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.136922 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:03.137043 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:03.137026 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:47:03.137102 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.137083 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:03.137162 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:03.137144 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:47:03.388381 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.388316 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 08:47:03.388961 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.388683 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" event={"ID":"13e9b35e-dd8f-460e-b5a7-a2689386c582","Type":"ContainerStarted","Data":"abcc242e3f8c8bdbe17d9bfc49c601ca120313f5b8a5a9c302836b8f6db453c2"} Sep 11 08:47:03.388961 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.388803 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 11 08:47:03.415139 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.415078 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" podStartSLOduration=8.974236703 podStartE2EDuration="27.415058668s" totalImagesPullingTime="18.440821965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:03.414805306 +0000 UTC m=+27.742182245" watchObservedRunningTime="2026-09-11 08:47:03.415058668 +0000 UTC m=+27.742435608" Sep 11 08:47:03.850752 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.850674 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9xp5k"] Sep 11 08:47:03.850948 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.850793 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:03.851018 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:03.850937 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:47:03.853736 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.853707 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgbhf"] Sep 11 08:47:03.854009 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.853818 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:03.854009 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:03.853937 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:47:03.854521 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.854496 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c2fvf"] Sep 11 08:47:03.854622 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:03.854587 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:03.854704 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:03.854683 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:47:04.393347 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:04.393314 2584 generic.go:356] "Generic (PLEG): container finished" podID="208c8836-9e40-4532-b9f1-02b4030fc364" containerID="40741b6e03125bae97ba20c6eb0d2af7150706bc4f21068ed3601d7927d48700" exitCode=0 Sep 11 08:47:04.394050 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:04.393401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" event={"ID":"208c8836-9e40-4532-b9f1-02b4030fc364","Type":"ContainerDied","Data":"40741b6e03125bae97ba20c6eb0d2af7150706bc4f21068ed3601d7927d48700"} Sep 11 08:47:04.394050 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:04.393563 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 11 08:47:05.134989 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:05.134864 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:05.134989 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:05.134982 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:47:05.135176 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:05.134864 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:05.135176 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:05.134895 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:05.135176 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:05.135117 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:47:05.135277 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:05.135206 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:47:06.401389 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:06.401358 2584 generic.go:356] "Generic (PLEG): container finished" podID="208c8836-9e40-4532-b9f1-02b4030fc364" containerID="b7543a24e1c5071a239e65d3d2b5a24cf83885bb7bc25c547daa6bf04f532da3" exitCode=0 Sep 11 08:47:06.401756 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:06.401408 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" event={"ID":"208c8836-9e40-4532-b9f1-02b4030fc364","Type":"ContainerDied","Data":"b7543a24e1c5071a239e65d3d2b5a24cf83885bb7bc25c547daa6bf04f532da3"} Sep 11 08:47:06.845605 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:06.845527 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:47:06.845765 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:06.845728 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 11 08:47:06.855468 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:06.855431 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" podUID="13e9b35e-dd8f-460e-b5a7-a2689386c582" containerName="ovnkube-controller" probeResult="failure" output="" Sep 11 08:47:06.863533 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:06.863505 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" podUID="13e9b35e-dd8f-460e-b5a7-a2689386c582" containerName="ovnkube-controller" probeResult="failure" output="" Sep 11 08:47:07.135102 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:07.135014 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:07.135102 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:07.135044 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:07.135297 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:07.135127 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:07.135297 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:07.135139 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c2fvf" podUID="5bd3198a-fe39-49bd-bce0-fc4930f5a1b5" Sep 11 08:47:07.135297 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:07.135231 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kgbhf" podUID="c67f45da-f058-4d7c-91ad-486492813cb1" Sep 11 08:47:07.135440 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:07.135358 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9xp5k" podUID="88ce320d-1c5f-4f87-9cbd-0cee5cb7c076" Sep 11 08:47:08.789693 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.789662 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:08.790171 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:08.789861 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 08:47:08.790171 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:08.789908 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 08:47:08.790171 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:08.789924 2584 projected.go:196] Error preparing data for projected volume kube-api-access-k6lcx for pod openshift-network-diagnostics/network-check-target-kgbhf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:47:08.790171 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:08.789995 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx podName:c67f45da-f058-4d7c-91ad-486492813cb1 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:40.789973905 +0000 UTC m=+65.117350841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k6lcx" (UniqueName: "kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx") pod "network-check-target-kgbhf" (UID: "c67f45da-f058-4d7c-91ad-486492813cb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 08:47:08.890372 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.890342 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:08.890492 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.890379 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:08.890492 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:08.890474 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 08:47:08.890555 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:08.890528 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret podName:5bd3198a-fe39-49bd-bce0-fc4930f5a1b5 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:40.890513358 +0000 UTC m=+65.217890275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret") pod "global-pull-secret-syncer-c2fvf" (UID: "5bd3198a-fe39-49bd-bce0-fc4930f5a1b5") : object "kube-system"/"original-pull-secret" not registered Sep 11 08:47:08.890555 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:08.890476 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:47:08.890621 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:08.890600 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs podName:88ce320d-1c5f-4f87-9cbd-0cee5cb7c076 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:40.890586307 +0000 UTC m=+65.217963229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs") pod "network-metrics-daemon-9xp5k" (UID: "88ce320d-1c5f-4f87-9cbd-0cee5cb7c076") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 08:47:08.945603 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.945577 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-35.ec2.internal" event="NodeReady" Sep 11 08:47:08.945755 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.945730 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 08:47:08.992130 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.992041 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8bpqk"] Sep 11 08:47:08.996083 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.996027 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-78sm2"] Sep 11 08:47:08.996208 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.996163 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:08.997829 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.997809 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 08:47:08.998047 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.998031 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7fqkq\"" Sep 11 08:47:08.998106 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.998053 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 08:47:08.999681 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:08.999663 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-78sm2" Sep 11 08:47:09.001093 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.001074 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 08:47:09.001223 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.001208 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 08:47:09.001292 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.001272 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 08:47:09.001347 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.001300 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q7bhf\"" Sep 11 08:47:09.003062 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.003043 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-78sm2"] Sep 11 08:47:09.006162 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.006139 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8bpqk"] Sep 11 08:47:09.091337 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.091307 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/959dec7d-698c-439a-9658-56ec6292f667-cert\") pod \"ingress-canary-78sm2\" (UID: \"959dec7d-698c-439a-9658-56ec6292f667\") " pod="openshift-ingress-canary/ingress-canary-78sm2" Sep 11 08:47:09.091519 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.091361 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qjbx\" (UniqueName: \"kubernetes.io/projected/959dec7d-698c-439a-9658-56ec6292f667-kube-api-access-2qjbx\") pod \"ingress-canary-78sm2\" (UID: \"959dec7d-698c-439a-9658-56ec6292f667\") " pod="openshift-ingress-canary/ingress-canary-78sm2" Sep 11 08:47:09.091519 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.091390 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-tmp-dir\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.091640 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.091528 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-config-volume\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.091640 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.091561 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.091640 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.091580 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fxh\" (UniqueName: \"kubernetes.io/projected/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-kube-api-access-n8fxh\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.134763 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.134734 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:09.134936 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.134807 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:09.134936 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.134822 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:09.137111 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.137090 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 08:47:09.137196 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.137159 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 08:47:09.137253 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.137236 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 08:47:09.137336 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.137321 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xm9k4\"" Sep 11 08:47:09.137371 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.137354 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wbz7z\"" Sep 11 08:47:09.137557 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.137543 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 08:47:09.192563 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.192534 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjbx\" (UniqueName: \"kubernetes.io/projected/959dec7d-698c-439a-9658-56ec6292f667-kube-api-access-2qjbx\") pod \"ingress-canary-78sm2\" (UID: \"959dec7d-698c-439a-9658-56ec6292f667\") " pod="openshift-ingress-canary/ingress-canary-78sm2" Sep 11 08:47:09.192677 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.192566 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-tmp-dir\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.192677 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.192607 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-config-volume\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.192677 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.192626 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.192677 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.192663 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fxh\" (UniqueName: \"kubernetes.io/projected/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-kube-api-access-n8fxh\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.192862 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.192712 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/959dec7d-698c-439a-9658-56ec6292f667-cert\") pod \"ingress-canary-78sm2\" (UID: \"959dec7d-698c-439a-9658-56ec6292f667\") " pod="openshift-ingress-canary/ingress-canary-78sm2" Sep 11 08:47:09.192862 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:09.192796 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:47:09.192992 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:09.192863 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls podName:e247b1d1-3872-4a7f-bfc3-7f7750830dd2 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:09.692841126 +0000 UTC m=+34.020218064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls") pod "dns-default-8bpqk" (UID: "e247b1d1-3872-4a7f-bfc3-7f7750830dd2") : secret "dns-default-metrics-tls" not found Sep 11 08:47:09.192992 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.192975 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-tmp-dir\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.193161 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.193144 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-config-volume\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.196868 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.196849 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/959dec7d-698c-439a-9658-56ec6292f667-cert\") pod \"ingress-canary-78sm2\" (UID: \"959dec7d-698c-439a-9658-56ec6292f667\") " pod="openshift-ingress-canary/ingress-canary-78sm2" Sep 11 08:47:09.200441 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.200419 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qjbx\" (UniqueName: \"kubernetes.io/projected/959dec7d-698c-439a-9658-56ec6292f667-kube-api-access-2qjbx\") pod \"ingress-canary-78sm2\" (UID: \"959dec7d-698c-439a-9658-56ec6292f667\") " pod="openshift-ingress-canary/ingress-canary-78sm2" Sep 11 08:47:09.200541 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.200498 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fxh\" (UniqueName: \"kubernetes.io/projected/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-kube-api-access-n8fxh\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.313010 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.312932 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-78sm2" Sep 11 08:47:09.600642 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.600424 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-78sm2"] Sep 11 08:47:09.604436 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:09.604405 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959dec7d_698c_439a_9658_56ec6292f667.slice/crio-47fa506b088004227eca0a37f06a41983b0193bde83db3d10b8c985e72e2d87f WatchSource:0}: Error finding container 47fa506b088004227eca0a37f06a41983b0193bde83db3d10b8c985e72e2d87f: Status 404 returned error can't find the container with id 47fa506b088004227eca0a37f06a41983b0193bde83db3d10b8c985e72e2d87f Sep 11 08:47:09.696644 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:09.696610 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:09.696805 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:09.696771 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:47:09.696863 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:09.696848 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls podName:e247b1d1-3872-4a7f-bfc3-7f7750830dd2 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:10.696827206 +0000 UTC m=+35.024204131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls") pod "dns-default-8bpqk" (UID: "e247b1d1-3872-4a7f-bfc3-7f7750830dd2") : secret "dns-default-metrics-tls" not found Sep 11 08:47:10.043628 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.043593 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd"] Sep 11 08:47:10.046213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.046190 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" Sep 11 08:47:10.048036 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.048014 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 11 08:47:10.048157 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.048050 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 11 08:47:10.048211 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.048014 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8djmm\"" Sep 11 08:47:10.054599 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.054570 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd"] Sep 11 08:47:10.201702 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.201669 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8z86\" (UniqueName: \"kubernetes.io/projected/222ef99a-7b1a-4855-a343-bd99c2edbc94-kube-api-access-j8z86\") pod \"migrator-8b4d697c5-s4lfd\" (UID: \"222ef99a-7b1a-4855-a343-bd99c2edbc94\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" Sep 11 08:47:10.302557 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.302471 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8z86\" (UniqueName: \"kubernetes.io/projected/222ef99a-7b1a-4855-a343-bd99c2edbc94-kube-api-access-j8z86\") pod \"migrator-8b4d697c5-s4lfd\" (UID: \"222ef99a-7b1a-4855-a343-bd99c2edbc94\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" Sep 11 08:47:10.313993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.313960 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8z86\" (UniqueName: \"kubernetes.io/projected/222ef99a-7b1a-4855-a343-bd99c2edbc94-kube-api-access-j8z86\") pod \"migrator-8b4d697c5-s4lfd\" (UID: \"222ef99a-7b1a-4855-a343-bd99c2edbc94\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" Sep 11 08:47:10.326193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.326106 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-88vjx"] Sep 11 08:47:10.328282 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.328261 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.332253 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.332226 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 08:47:10.332338 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.332273 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 08:47:10.332546 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.332527 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 08:47:10.332546 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.332539 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xbkxl\"" Sep 11 08:47:10.332639 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.332585 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 08:47:10.349978 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.349950 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-88vjx"] Sep 11 08:47:10.357331 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.357312 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" Sep 11 08:47:10.413212 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.413172 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-78sm2" event={"ID":"959dec7d-698c-439a-9658-56ec6292f667","Type":"ContainerStarted","Data":"47fa506b088004227eca0a37f06a41983b0193bde83db3d10b8c985e72e2d87f"} Sep 11 08:47:10.503949 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.503908 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npz9j\" (UniqueName: \"kubernetes.io/projected/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-api-access-npz9j\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.504131 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.503962 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c793c346-5d35-4755-ad41-52b4ec6e7305-data-volume\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.504131 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.504041 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c793c346-5d35-4755-ad41-52b4ec6e7305-crio-socket\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.504131 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.504077 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.504267 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.504150 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.605108 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.605029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npz9j\" (UniqueName: \"kubernetes.io/projected/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-api-access-npz9j\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.605108 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.605069 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c793c346-5d35-4755-ad41-52b4ec6e7305-data-volume\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.605108 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.605090 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c793c346-5d35-4755-ad41-52b4ec6e7305-crio-socket\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.605108 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.605105 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.605400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.605160 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.605400 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:10.605260 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 08:47:10.605400 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:10.605328 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-rbac-proxy-cm podName:c793c346-5d35-4755-ad41-52b4ec6e7305 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:11.105308141 +0000 UTC m=+35.432685082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-rbac-proxy-cm") pod "insights-runtime-extractor-88vjx" (UID: "c793c346-5d35-4755-ad41-52b4ec6e7305") : configmap "kube-rbac-proxy" not found Sep 11 08:47:10.605549 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.605464 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c793c346-5d35-4755-ad41-52b4ec6e7305-data-volume\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.605598 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:10.605576 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:47:10.605647 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.605605 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c793c346-5d35-4755-ad41-52b4ec6e7305-crio-socket\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.605647 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:10.605644 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls podName:c793c346-5d35-4755-ad41-52b4ec6e7305 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:11.105625552 +0000 UTC m=+35.433002475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88vjx" (UID: "c793c346-5d35-4755-ad41-52b4ec6e7305") : secret "insights-runtime-extractor-tls" not found Sep 11 08:47:10.613339 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.613316 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npz9j\" (UniqueName: \"kubernetes.io/projected/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-api-access-npz9j\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:10.706469 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:10.706434 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:10.706657 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:10.706595 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:47:10.706721 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:10.706661 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls podName:e247b1d1-3872-4a7f-bfc3-7f7750830dd2 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:12.70664143 +0000 UTC m=+37.034018372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls") pod "dns-default-8bpqk" (UID: "e247b1d1-3872-4a7f-bfc3-7f7750830dd2") : secret "dns-default-metrics-tls" not found Sep 11 08:47:11.110741 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:11.110666 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:11.111327 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:11.110755 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:11.111465 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:11.111437 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c793c346-5d35-4755-ad41-52b4ec6e7305-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:11.111589 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:11.111503 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:47:11.111589 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:11.111563 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls podName:c793c346-5d35-4755-ad41-52b4ec6e7305 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:12.111548618 +0000 UTC m=+36.438925553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88vjx" (UID: "c793c346-5d35-4755-ad41-52b4ec6e7305") : secret "insights-runtime-extractor-tls" not found Sep 11 08:47:11.560016 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:11.559987 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd"] Sep 11 08:47:11.565472 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:11.563129 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod222ef99a_7b1a_4855_a343_bd99c2edbc94.slice/crio-4830e012f9b5fd73dac440f489e583f69b795d648557cff4ed430be4c180b0c6 WatchSource:0}: Error finding container 4830e012f9b5fd73dac440f489e583f69b795d648557cff4ed430be4c180b0c6: Status 404 returned error can't find the container with id 4830e012f9b5fd73dac440f489e583f69b795d648557cff4ed430be4c180b0c6 Sep 11 08:47:12.120042 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:12.120008 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:12.120646 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:12.120185 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:47:12.120646 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:12.120444 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls podName:c793c346-5d35-4755-ad41-52b4ec6e7305 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:14.12042811 +0000 UTC m=+38.447805031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88vjx" (UID: "c793c346-5d35-4755-ad41-52b4ec6e7305") : secret "insights-runtime-extractor-tls" not found Sep 11 08:47:12.423497 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:12.423451 2584 generic.go:356] "Generic (PLEG): container finished" podID="208c8836-9e40-4532-b9f1-02b4030fc364" containerID="435cdcfa829ff6350d89d576c5e70812d1d5409364bf500cf14fba096dc5fe9e" exitCode=0 Sep 11 08:47:12.423681 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:12.423529 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" event={"ID":"208c8836-9e40-4532-b9f1-02b4030fc364","Type":"ContainerDied","Data":"435cdcfa829ff6350d89d576c5e70812d1d5409364bf500cf14fba096dc5fe9e"} Sep 11 08:47:12.424916 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:12.424864 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" event={"ID":"222ef99a-7b1a-4855-a343-bd99c2edbc94","Type":"ContainerStarted","Data":"4830e012f9b5fd73dac440f489e583f69b795d648557cff4ed430be4c180b0c6"} Sep 11 08:47:12.724301 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:12.724189 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:12.724442 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:12.724356 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:47:12.724442 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:12.724428 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls podName:e247b1d1-3872-4a7f-bfc3-7f7750830dd2 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:16.724407322 +0000 UTC m=+41.051784264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls") pod "dns-default-8bpqk" (UID: "e247b1d1-3872-4a7f-bfc3-7f7750830dd2") : secret "dns-default-metrics-tls" not found Sep 11 08:47:13.268807 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:13.268782 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rwdtp_759ae063-04b2-4e1c-a2af-a608761aca21/dns-node-resolver/0.log" Sep 11 08:47:14.135002 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.134969 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:14.135169 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:14.135124 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:47:14.135210 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:14.135189 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls podName:c793c346-5d35-4755-ad41-52b4ec6e7305 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:18.135171132 +0000 UTC m=+42.462548061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88vjx" (UID: "c793c346-5d35-4755-ad41-52b4ec6e7305") : secret "insights-runtime-extractor-tls" not found Sep 11 08:47:14.268868 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.268835 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-srk4w_f8f5a742-7b52-4fb4-a027-0c19181fb247/node-ca/0.log" Sep 11 08:47:14.431801 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.431767 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-78sm2" event={"ID":"959dec7d-698c-439a-9658-56ec6292f667","Type":"ContainerStarted","Data":"e33ef57929abc3209e29a04738c2b5391152244a72e2f934e5366a06e3b10dfe"} Sep 11 08:47:14.433597 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.433570 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" event={"ID":"222ef99a-7b1a-4855-a343-bd99c2edbc94","Type":"ContainerStarted","Data":"5b4890d3e0001d0dc801f44cb9ffd2a8ad47afa9fd4284a65ead24fbb73a9d31"} Sep 11 08:47:14.433726 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.433621 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" event={"ID":"222ef99a-7b1a-4855-a343-bd99c2edbc94","Type":"ContainerStarted","Data":"3efdb38158464263ad765a3fbaf31b5f17c5ed32f57a361b34627044f9be43d5"} Sep 11 08:47:14.436668 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.436648 2584 generic.go:356] "Generic (PLEG): container finished" podID="208c8836-9e40-4532-b9f1-02b4030fc364" containerID="92060d855974d91338b0af4b1f58c9582726e1345ddb0c3b622cda29c5b7829e" exitCode=0 Sep 11 08:47:14.436760 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.436684 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" event={"ID":"208c8836-9e40-4532-b9f1-02b4030fc364","Type":"ContainerDied","Data":"92060d855974d91338b0af4b1f58c9582726e1345ddb0c3b622cda29c5b7829e"} Sep 11 08:47:14.446588 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.446548 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-78sm2" podStartSLOduration=2.28541004 podStartE2EDuration="6.446533614s" totalImagesPullingTime="4.161123574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:14.446342537 +0000 UTC m=+38.773719477" watchObservedRunningTime="2026-09-11 08:47:14.446533614 +0000 UTC m=+38.773910553" Sep 11 08:47:14.483143 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.483082 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4lfd" podStartSLOduration=2.278109801 podStartE2EDuration="4.483059745s" totalImagesPullingTime="2.204949944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:14.481808838 +0000 UTC m=+38.809185776" watchObservedRunningTime="2026-09-11 08:47:14.483059745 +0000 UTC m=+38.810436682" Sep 11 08:47:14.869338 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:14.869256 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-78sm2_959dec7d-698c-439a-9658-56ec6292f667/serve-healthcheck-canary/0.log" Sep 11 08:47:15.269857 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:15.269822 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-s4lfd_222ef99a-7b1a-4855-a343-bd99c2edbc94/migrator/0.log" Sep 11 08:47:15.443297 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:15.443265 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" event={"ID":"208c8836-9e40-4532-b9f1-02b4030fc364","Type":"ContainerStarted","Data":"fda1e0f50bdd81b0772951deaacd77a3c7dc3e3b72fd48c6fe143dac20d3d087"} Sep 11 08:47:15.481095 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:15.481071 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-s4lfd_222ef99a-7b1a-4855-a343-bd99c2edbc94/graceful-termination/0.log" Sep 11 08:47:15.512802 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:15.512750 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b7sgn" podStartSLOduration=9.24791311 podStartE2EDuration="39.512733186s" totalImagesPullingTime="30.264820076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:15.512052116 +0000 UTC m=+39.839429058" watchObservedRunningTime="2026-09-11 08:47:15.512733186 +0000 UTC m=+39.840110124" Sep 11 08:47:16.754166 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:16.754134 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:16.754506 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:16.754248 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 08:47:16.754506 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:16.754301 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls podName:e247b1d1-3872-4a7f-bfc3-7f7750830dd2 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:24.754287766 +0000 UTC m=+49.081664683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls") pod "dns-default-8bpqk" (UID: "e247b1d1-3872-4a7f-bfc3-7f7750830dd2") : secret "dns-default-metrics-tls" not found Sep 11 08:47:18.163058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:18.163017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:18.163458 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:18.163156 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 08:47:18.163458 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:18.163219 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls podName:c793c346-5d35-4755-ad41-52b4ec6e7305 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:26.163204313 +0000 UTC m=+50.490581231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88vjx" (UID: "c793c346-5d35-4755-ad41-52b4ec6e7305") : secret "insights-runtime-extractor-tls" not found Sep 11 08:47:24.812546 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:24.812506 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:24.815802 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:24.815780 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e247b1d1-3872-4a7f-bfc3-7f7750830dd2-metrics-tls\") pod \"dns-default-8bpqk\" (UID: \"e247b1d1-3872-4a7f-bfc3-7f7750830dd2\") " pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:24.907270 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:24.907232 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:25.208202 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:25.208169 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8bpqk"] Sep 11 08:47:25.212422 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:25.212393 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode247b1d1_3872_4a7f_bfc3_7f7750830dd2.slice/crio-37bccc8e5649a02e3bd42704c53f9f98ce9183102d7eea6aacff2b9241b06322 WatchSource:0}: Error finding container 37bccc8e5649a02e3bd42704c53f9f98ce9183102d7eea6aacff2b9241b06322: Status 404 returned error can't find the container with id 37bccc8e5649a02e3bd42704c53f9f98ce9183102d7eea6aacff2b9241b06322 Sep 11 08:47:25.469673 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:25.469587 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bpqk" event={"ID":"e247b1d1-3872-4a7f-bfc3-7f7750830dd2","Type":"ContainerStarted","Data":"37bccc8e5649a02e3bd42704c53f9f98ce9183102d7eea6aacff2b9241b06322"} Sep 11 08:47:26.221691 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:26.221657 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:26.224283 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:26.224251 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c793c346-5d35-4755-ad41-52b4ec6e7305-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88vjx\" (UID: \"c793c346-5d35-4755-ad41-52b4ec6e7305\") " pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:26.238143 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:26.238120 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-88vjx" Sep 11 08:47:26.530438 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:26.530251 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-88vjx"] Sep 11 08:47:26.794797 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:26.794718 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc793c346_5d35_4755_ad41_52b4ec6e7305.slice/crio-91fb49eef4f92a17f5758d810f6f4bd70ca111107d601b0ace1da756317d3375 WatchSource:0}: Error finding container 91fb49eef4f92a17f5758d810f6f4bd70ca111107d601b0ace1da756317d3375: Status 404 returned error can't find the container with id 91fb49eef4f92a17f5758d810f6f4bd70ca111107d601b0ace1da756317d3375 Sep 11 08:47:27.477136 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:27.477106 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bpqk" event={"ID":"e247b1d1-3872-4a7f-bfc3-7f7750830dd2","Type":"ContainerStarted","Data":"868cb7bbab3a9774dca4ed514687981e700c99ec047de6b05d38c9136d34eeb2"} Sep 11 08:47:27.477491 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:27.477160 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bpqk" event={"ID":"e247b1d1-3872-4a7f-bfc3-7f7750830dd2","Type":"ContainerStarted","Data":"08bf72ddc5636c789e2280aa5fcc90a5332d3863a08190cc7fd43acf61600df9"} Sep 11 08:47:27.477491 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:27.477240 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:27.478602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:27.478584 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88vjx" event={"ID":"c793c346-5d35-4755-ad41-52b4ec6e7305","Type":"ContainerStarted","Data":"1dad204c27399ed7445a696542d688f95d1ec606e5f7adeefbd24e024dd00f09"} Sep 11 08:47:27.478666 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:27.478622 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88vjx" event={"ID":"c793c346-5d35-4755-ad41-52b4ec6e7305","Type":"ContainerStarted","Data":"91fb49eef4f92a17f5758d810f6f4bd70ca111107d601b0ace1da756317d3375"} Sep 11 08:47:27.492263 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:27.492220 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8bpqk" podStartSLOduration=17.880810684 podStartE2EDuration="19.492204405s" totalImagesPullingTime="1.611393721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:27.491676233 +0000 UTC m=+51.819053173" watchObservedRunningTime="2026-09-11 08:47:27.492204405 +0000 UTC m=+51.819581386" Sep 11 08:47:28.485617 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:28.485482 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88vjx" event={"ID":"c793c346-5d35-4755-ad41-52b4ec6e7305","Type":"ContainerStarted","Data":"317ff494f1fa094294c0613e7ba2f22f30073d11d24e206ddc0da3c4acf66f03"} Sep 11 08:47:29.490524 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:29.490485 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88vjx" event={"ID":"c793c346-5d35-4755-ad41-52b4ec6e7305","Type":"ContainerStarted","Data":"1270bb34a3d0ad4483d5f5b0923c55d748b98ab88becec9b35baf3e9ccce4072"} Sep 11 08:47:29.506744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:29.506697 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-88vjx" podStartSLOduration=17.481797794 podStartE2EDuration="19.506683484s" totalImagesPullingTime="2.02488569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:47:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:29.505805654 +0000 UTC m=+53.833182606" watchObservedRunningTime="2026-09-11 08:47:29.506683484 +0000 UTC m=+53.834060422" Sep 11 08:47:34.105761 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.105727 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn"] Sep 11 08:47:34.108346 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.108324 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" Sep 11 08:47:34.112075 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.112045 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cpsdq\"" Sep 11 08:47:34.112199 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.112079 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 11 08:47:34.112199 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.112148 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 11 08:47:34.112304 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.112221 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 11 08:47:34.114608 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.114589 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 11 08:47:34.132379 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.132353 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn"] Sep 11 08:47:34.180337 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.180296 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99838810-bed8-4ddd-89d2-35e11820f97d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-559f9498b4-d2xpn\" (UID: \"99838810-bed8-4ddd-89d2-35e11820f97d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" Sep 11 08:47:34.180337 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.180336 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h6ww\" (UniqueName: \"kubernetes.io/projected/99838810-bed8-4ddd-89d2-35e11820f97d-kube-api-access-2h6ww\") pod \"managed-serviceaccount-addon-agent-559f9498b4-d2xpn\" (UID: \"99838810-bed8-4ddd-89d2-35e11820f97d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" Sep 11 08:47:34.261485 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.261451 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp"] Sep 11 08:47:34.263306 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.263290 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" Sep 11 08:47:34.268115 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.268088 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7b84q\"" Sep 11 08:47:34.268257 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.268089 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 11 08:47:34.268654 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.268636 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 11 08:47:34.281390 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.281363 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/287b64ea-6bed-41b3-9793-2c295a10fa8a-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-m6jwp\" (UID: \"287b64ea-6bed-41b3-9793-2c295a10fa8a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" Sep 11 08:47:34.281510 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.281397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/287b64ea-6bed-41b3-9793-2c295a10fa8a-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-m6jwp\" (UID: \"287b64ea-6bed-41b3-9793-2c295a10fa8a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" Sep 11 08:47:34.281510 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.281420 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99838810-bed8-4ddd-89d2-35e11820f97d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-559f9498b4-d2xpn\" (UID: \"99838810-bed8-4ddd-89d2-35e11820f97d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" Sep 11 08:47:34.281510 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.281436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h6ww\" (UniqueName: \"kubernetes.io/projected/99838810-bed8-4ddd-89d2-35e11820f97d-kube-api-access-2h6ww\") pod \"managed-serviceaccount-addon-agent-559f9498b4-d2xpn\" (UID: \"99838810-bed8-4ddd-89d2-35e11820f97d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" Sep 11 08:47:34.284047 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.284018 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99838810-bed8-4ddd-89d2-35e11820f97d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-559f9498b4-d2xpn\" (UID: \"99838810-bed8-4ddd-89d2-35e11820f97d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" Sep 11 08:47:34.297257 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.297230 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp"] Sep 11 08:47:34.318247 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.318212 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h6ww\" (UniqueName: \"kubernetes.io/projected/99838810-bed8-4ddd-89d2-35e11820f97d-kube-api-access-2h6ww\") pod \"managed-serviceaccount-addon-agent-559f9498b4-d2xpn\" (UID: \"99838810-bed8-4ddd-89d2-35e11820f97d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" Sep 11 08:47:34.381895 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.381802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/287b64ea-6bed-41b3-9793-2c295a10fa8a-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-m6jwp\" (UID: \"287b64ea-6bed-41b3-9793-2c295a10fa8a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" Sep 11 08:47:34.381895 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.381835 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/287b64ea-6bed-41b3-9793-2c295a10fa8a-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-m6jwp\" (UID: \"287b64ea-6bed-41b3-9793-2c295a10fa8a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" Sep 11 08:47:34.382484 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.382462 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/287b64ea-6bed-41b3-9793-2c295a10fa8a-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-m6jwp\" (UID: \"287b64ea-6bed-41b3-9793-2c295a10fa8a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" Sep 11 08:47:34.384132 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.384115 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/287b64ea-6bed-41b3-9793-2c295a10fa8a-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-m6jwp\" (UID: \"287b64ea-6bed-41b3-9793-2c295a10fa8a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" Sep 11 08:47:34.427740 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.427702 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" Sep 11 08:47:34.485854 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.485821 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7976d8b549-hcg2g"] Sep 11 08:47:34.488233 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.488209 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.495733 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.495713 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 11 08:47:34.495842 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.495768 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 11 08:47:34.496314 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.496296 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 11 08:47:34.496385 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.496345 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l57fw\"" Sep 11 08:47:34.503437 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.503416 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7976d8b549-hcg2g"] Sep 11 08:47:34.505417 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.505395 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 11 08:47:34.571584 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.571548 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" Sep 11 08:47:34.583668 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.583641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-registry-certificates\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.583756 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.583677 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2j2f\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-kube-api-access-r2j2f\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.583756 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.583694 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-registry-tls\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.583832 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.583761 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-ca-trust-extracted\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.583832 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.583794 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-bound-sa-token\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.583922 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.583842 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-image-registry-private-configuration\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.583922 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.583892 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-trusted-ca\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.584024 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.583979 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-installation-pull-secrets\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.684985 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.684950 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-image-registry-private-configuration\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.684985 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.684986 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-trusted-ca\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.685180 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.685009 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-installation-pull-secrets\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.685180 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.685035 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-registry-certificates\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.685180 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.685057 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2j2f\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-kube-api-access-r2j2f\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.685180 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.685076 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-registry-tls\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.685180 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.685132 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-ca-trust-extracted\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.685180 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.685155 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-bound-sa-token\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.685644 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.685617 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-ca-trust-extracted\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.686011 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.685987 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-registry-certificates\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.686301 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.686276 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-trusted-ca\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.687706 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.687683 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-installation-pull-secrets\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.687793 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.687688 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-image-registry-private-configuration\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.687793 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.687723 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-registry-tls\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.696508 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.696484 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn"] Sep 11 08:47:34.699063 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.699041 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2j2f\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-kube-api-access-r2j2f\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.699779 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:34.699756 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99838810_bed8_4ddd_89d2_35e11820f97d.slice/crio-8c5255493b7d13fcd865d7f68cbb278b888fd321fdb0225c67a6d26f1bea0390 WatchSource:0}: Error finding container 8c5255493b7d13fcd865d7f68cbb278b888fd321fdb0225c67a6d26f1bea0390: Status 404 returned error can't find the container with id 8c5255493b7d13fcd865d7f68cbb278b888fd321fdb0225c67a6d26f1bea0390 Sep 11 08:47:34.699865 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.699808 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bba807c-4ddd-4699-a0ae-e1e38d6500bd-bound-sa-token\") pod \"image-registry-7976d8b549-hcg2g\" (UID: \"0bba807c-4ddd-4699-a0ae-e1e38d6500bd\") " pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.798023 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.797985 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:34.842708 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:34.842563 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp"] Sep 11 08:47:34.854195 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:34.854169 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287b64ea_6bed_41b3_9793_2c295a10fa8a.slice/crio-a3fa811ddf247b81ac0217a2da72b8625783163f09057f397b768344977723ba WatchSource:0}: Error finding container a3fa811ddf247b81ac0217a2da72b8625783163f09057f397b768344977723ba: Status 404 returned error can't find the container with id a3fa811ddf247b81ac0217a2da72b8625783163f09057f397b768344977723ba Sep 11 08:47:35.073936 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:35.073842 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7976d8b549-hcg2g"] Sep 11 08:47:35.076573 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:35.076547 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bba807c_4ddd_4699_a0ae_e1e38d6500bd.slice/crio-5fcb9ac00b27c2e45a5c45ad93ab36626052bca6cdfcfcdd95875a00f0d510bd WatchSource:0}: Error finding container 5fcb9ac00b27c2e45a5c45ad93ab36626052bca6cdfcfcdd95875a00f0d510bd: Status 404 returned error can't find the container with id 5fcb9ac00b27c2e45a5c45ad93ab36626052bca6cdfcfcdd95875a00f0d510bd Sep 11 08:47:35.525571 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:35.525535 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" event={"ID":"0bba807c-4ddd-4699-a0ae-e1e38d6500bd","Type":"ContainerStarted","Data":"b70b741b691fe9ad4ca038cc78e5d5cc70047eaafa3e66eeebf10d250044deff"} Sep 11 08:47:35.526586 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:35.526546 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" event={"ID":"0bba807c-4ddd-4699-a0ae-e1e38d6500bd","Type":"ContainerStarted","Data":"5fcb9ac00b27c2e45a5c45ad93ab36626052bca6cdfcfcdd95875a00f0d510bd"} Sep 11 08:47:35.526913 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:35.526897 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:35.527577 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:35.527522 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" event={"ID":"287b64ea-6bed-41b3-9793-2c295a10fa8a","Type":"ContainerStarted","Data":"a3fa811ddf247b81ac0217a2da72b8625783163f09057f397b768344977723ba"} Sep 11 08:47:35.529916 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:35.529893 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" event={"ID":"99838810-bed8-4ddd-89d2-35e11820f97d","Type":"ContainerStarted","Data":"8c5255493b7d13fcd865d7f68cbb278b888fd321fdb0225c67a6d26f1bea0390"} Sep 11 08:47:35.576386 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:35.575565 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" podStartSLOduration=1.575543769 podStartE2EDuration="1.575543769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:35.575291874 +0000 UTC m=+59.902668816" watchObservedRunningTime="2026-09-11 08:47:35.575543769 +0000 UTC m=+59.902920691" Sep 11 08:47:36.092811 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.092778 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn"] Sep 11 08:47:36.094694 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.094666 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" Sep 11 08:47:36.096621 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.096600 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6gmxz\"" Sep 11 08:47:36.097104 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.097088 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 11 08:47:36.107978 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.107954 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn"] Sep 11 08:47:36.196777 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.196736 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95cf7046-4d66-4dad-adeb-968f4a5fb073-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-jxbfn\" (UID: \"95cf7046-4d66-4dad-adeb-968f4a5fb073\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" Sep 11 08:47:36.298163 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.298121 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95cf7046-4d66-4dad-adeb-968f4a5fb073-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-jxbfn\" (UID: \"95cf7046-4d66-4dad-adeb-968f4a5fb073\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" Sep 11 08:47:36.300793 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.300764 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95cf7046-4d66-4dad-adeb-968f4a5fb073-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-jxbfn\" (UID: \"95cf7046-4d66-4dad-adeb-968f4a5fb073\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" Sep 11 08:47:36.408973 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.408925 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" Sep 11 08:47:36.535834 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.535789 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" event={"ID":"287b64ea-6bed-41b3-9793-2c295a10fa8a","Type":"ContainerStarted","Data":"e3d5bc6e12ef6c1333951572c07aad1e7f959d94940d87ca4cc713a55b49d9c1"} Sep 11 08:47:36.551432 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.551382 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-m6jwp" podStartSLOduration=1.298262029 podStartE2EDuration="2.551364633s" totalImagesPullingTime="1.253102604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:36.550704072 +0000 UTC m=+60.878081012" watchObservedRunningTime="2026-09-11 08:47:36.551364633 +0000 UTC m=+60.878741573" Sep 11 08:47:36.865849 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:36.865777 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxt2j" Sep 11 08:47:37.415686 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:37.415608 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn"] Sep 11 08:47:37.418641 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:37.418616 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cf7046_4d66_4dad_adeb_968f4a5fb073.slice/crio-47540a27165a7499ca0295c488f0e8ef18ab66d28f51339a859445424472b00a WatchSource:0}: Error finding container 47540a27165a7499ca0295c488f0e8ef18ab66d28f51339a859445424472b00a: Status 404 returned error can't find the container with id 47540a27165a7499ca0295c488f0e8ef18ab66d28f51339a859445424472b00a Sep 11 08:47:37.487816 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:37.487783 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8bpqk" Sep 11 08:47:37.541591 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:37.541558 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" event={"ID":"99838810-bed8-4ddd-89d2-35e11820f97d","Type":"ContainerStarted","Data":"efc787b14ba82bb81015c5230d96b0c394d981cbe98a19a3b13ba278c1a725c9"} Sep 11 08:47:37.542944 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:37.542914 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" event={"ID":"95cf7046-4d66-4dad-adeb-968f4a5fb073","Type":"ContainerStarted","Data":"47540a27165a7499ca0295c488f0e8ef18ab66d28f51339a859445424472b00a"} Sep 11 08:47:37.556956 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:37.556914 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-559f9498b4-d2xpn" podStartSLOduration=1.059372489 podStartE2EDuration="3.55689729s" totalImagesPullingTime="2.497524801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:37.556302472 +0000 UTC m=+61.883679413" watchObservedRunningTime="2026-09-11 08:47:37.55689729 +0000 UTC m=+61.884274221" Sep 11 08:47:38.547580 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:38.547544 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" event={"ID":"95cf7046-4d66-4dad-adeb-968f4a5fb073","Type":"ContainerStarted","Data":"c60f59e38f2f1d34cf2ed63b8fe70291aff381f6ee1d176a88a88014e56ef630"} Sep 11 08:47:38.562688 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:38.562639 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" podStartSLOduration=1.575167715 podStartE2EDuration="2.562622538s" totalImagesPullingTime="987.454823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:38.561614153 +0000 UTC m=+62.888991093" watchObservedRunningTime="2026-09-11 08:47:38.562622538 +0000 UTC m=+62.889999504" Sep 11 08:47:39.554137 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:39.554080 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" Sep 11 08:47:39.557749 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:39.557723 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-jxbfn" Sep 11 08:47:40.149046 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.149014 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk"] Sep 11 08:47:40.151078 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.151060 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.153599 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.153579 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qvn67\"" Sep 11 08:47:40.153711 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.153600 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 11 08:47:40.153711 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.153603 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 08:47:40.153711 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.153640 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 08:47:40.153711 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.153579 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 11 08:47:40.153711 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.153607 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 08:47:40.162727 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.162707 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk"] Sep 11 08:47:40.228135 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.228105 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.228286 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.228144 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.228286 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.228182 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6k6b\" (UniqueName: \"kubernetes.io/projected/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-kube-api-access-q6k6b\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.228286 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.228228 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.328686 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.328651 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6k6b\" (UniqueName: \"kubernetes.io/projected/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-kube-api-access-q6k6b\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.328840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.328815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.328928 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.328911 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.328971 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.328944 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.329618 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.329597 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.331208 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.331187 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.331312 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.331237 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.336464 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.336442 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6k6b\" (UniqueName: \"kubernetes.io/projected/e1b543cb-8a65-4e86-9f4d-1e1057403bf1-kube-api-access-q6k6b\") pod \"prometheus-operator-68bcd7f987-l4kqk\" (UID: \"e1b543cb-8a65-4e86-9f4d-1e1057403bf1\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.459626 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.459535 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" Sep 11 08:47:40.729800 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.729721 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk"] Sep 11 08:47:40.733405 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:40.733372 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b543cb_8a65_4e86_9f4d_1e1057403bf1.slice/crio-b38c8bcd8fc06f3debd7b5903ca845a80fc963d54c660ed9dd01182822593688 WatchSource:0}: Error finding container b38c8bcd8fc06f3debd7b5903ca845a80fc963d54c660ed9dd01182822593688: Status 404 returned error can't find the container with id b38c8bcd8fc06f3debd7b5903ca845a80fc963d54c660ed9dd01182822593688 Sep 11 08:47:40.833999 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.833960 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:40.836387 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.836370 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 08:47:40.847462 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.847443 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 08:47:40.857410 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.857388 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6lcx\" (UniqueName: \"kubernetes.io/projected/c67f45da-f058-4d7c-91ad-486492813cb1-kube-api-access-k6lcx\") pod \"network-check-target-kgbhf\" (UID: \"c67f45da-f058-4d7c-91ad-486492813cb1\") " pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:40.934551 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.934519 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:40.934624 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.934575 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:40.937816 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.937798 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 08:47:40.937865 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.937798 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 08:47:40.945732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.945703 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wbz7z\"" Sep 11 08:47:40.947250 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.947232 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88ce320d-1c5f-4f87-9cbd-0cee5cb7c076-metrics-certs\") pod \"network-metrics-daemon-9xp5k\" (UID: \"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076\") " pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:40.947317 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.947290 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5bd3198a-fe39-49bd-bce0-fc4930f5a1b5-original-pull-secret\") pod \"global-pull-secret-syncer-c2fvf\" (UID: \"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5\") " pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:40.951888 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.951863 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xm9k4\"" Sep 11 08:47:40.954463 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.954445 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:40.954463 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.954460 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c2fvf" Sep 11 08:47:40.961212 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:40.961195 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9xp5k" Sep 11 08:47:41.268052 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:41.268027 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd3198a_fe39_49bd_bce0_fc4930f5a1b5.slice/crio-0a78319809b2bcafd289169c44edd2ed0596fa8acead85a9f13c94268ac20b2b WatchSource:0}: Error finding container 0a78319809b2bcafd289169c44edd2ed0596fa8acead85a9f13c94268ac20b2b: Status 404 returned error can't find the container with id 0a78319809b2bcafd289169c44edd2ed0596fa8acead85a9f13c94268ac20b2b Sep 11 08:47:41.268298 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:41.268283 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c2fvf"] Sep 11 08:47:41.269183 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:41.269161 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kgbhf"] Sep 11 08:47:41.269301 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:41.269276 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc67f45da_f058_4d7c_91ad_486492813cb1.slice/crio-af77fa4efd9e2a275bd7175f9e57940eeb4ad19e97e4c60fb301b06e4b5ec127 WatchSource:0}: Error finding container af77fa4efd9e2a275bd7175f9e57940eeb4ad19e97e4c60fb301b06e4b5ec127: Status 404 returned error can't find the container with id af77fa4efd9e2a275bd7175f9e57940eeb4ad19e97e4c60fb301b06e4b5ec127 Sep 11 08:47:41.275427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:41.275356 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9xp5k"] Sep 11 08:47:41.277753 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:41.277722 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88ce320d_1c5f_4f87_9cbd_0cee5cb7c076.slice/crio-d80063d13af4d2eac938fe045d20acc12c91ce87684aeaaab71604f36922ddbb WatchSource:0}: Error finding container d80063d13af4d2eac938fe045d20acc12c91ce87684aeaaab71604f36922ddbb: Status 404 returned error can't find the container with id d80063d13af4d2eac938fe045d20acc12c91ce87684aeaaab71604f36922ddbb Sep 11 08:47:41.560269 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:41.560184 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgbhf" event={"ID":"c67f45da-f058-4d7c-91ad-486492813cb1","Type":"ContainerStarted","Data":"af77fa4efd9e2a275bd7175f9e57940eeb4ad19e97e4c60fb301b06e4b5ec127"} Sep 11 08:47:41.561657 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:41.561615 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9xp5k" event={"ID":"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076","Type":"ContainerStarted","Data":"d80063d13af4d2eac938fe045d20acc12c91ce87684aeaaab71604f36922ddbb"} Sep 11 08:47:41.563035 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:41.563011 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c2fvf" event={"ID":"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5","Type":"ContainerStarted","Data":"0a78319809b2bcafd289169c44edd2ed0596fa8acead85a9f13c94268ac20b2b"} Sep 11 08:47:41.564382 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:41.564360 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" event={"ID":"e1b543cb-8a65-4e86-9f4d-1e1057403bf1","Type":"ContainerStarted","Data":"b38c8bcd8fc06f3debd7b5903ca845a80fc963d54c660ed9dd01182822593688"} Sep 11 08:47:42.572019 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:42.571959 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" event={"ID":"e1b543cb-8a65-4e86-9f4d-1e1057403bf1","Type":"ContainerStarted","Data":"835a9c1c8539751e0feeda57e773f76bd9262fc1f9cef78769fa5680db45295f"} Sep 11 08:47:42.572465 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:42.572030 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" event={"ID":"e1b543cb-8a65-4e86-9f4d-1e1057403bf1","Type":"ContainerStarted","Data":"09c7d6e9dc1b22e500bbe01cf3a3b7ff7cd8509ba5ee7611fc474cd5c4a7b09b"} Sep 11 08:47:42.592089 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:42.591643 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-l4kqk" podStartSLOduration=1.3867684169999999 podStartE2EDuration="2.591619747s" totalImagesPullingTime="1.20485133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:42.590579688 +0000 UTC m=+66.917956630" watchObservedRunningTime="2026-09-11 08:47:42.591619747 +0000 UTC m=+66.918996690" Sep 11 08:47:43.580475 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:43.580437 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9xp5k" event={"ID":"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076","Type":"ContainerStarted","Data":"5865f7b943901b6d8b01b147133c60ccc6a7e51711de0801fd119ea17b023e04"} Sep 11 08:47:43.580954 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:43.580549 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9xp5k" event={"ID":"88ce320d-1c5f-4f87-9cbd-0cee5cb7c076","Type":"ContainerStarted","Data":"84fa0d46efa7776ddae1fe06deb5daf5ee26d6f2723b62a6f3bc6d36737bf26a"} Sep 11 08:47:43.598031 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:43.597964 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9xp5k" podStartSLOduration=66.170638913 podStartE2EDuration="1m7.597943971s" totalImagesPullingTime="1.427305058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:43.596638841 +0000 UTC m=+67.924015783" watchObservedRunningTime="2026-09-11 08:47:43.597943971 +0000 UTC m=+67.925320910" Sep 11 08:47:44.531434 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.531392 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg"] Sep 11 08:47:44.548591 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.548557 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jt9ml"] Sep 11 08:47:44.548923 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.548896 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.551263 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.551243 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 11 08:47:44.551383 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.551331 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 11 08:47:44.551440 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.551403 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 11 08:47:44.551440 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.551409 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-g5fhq\"" Sep 11 08:47:44.566042 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.565995 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg"] Sep 11 08:47:44.566170 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.566077 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.568326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.568296 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 08:47:44.568454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.568380 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2w95z\"" Sep 11 08:47:44.568454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.568311 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 08:47:44.568667 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.568650 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 08:47:44.666454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666415 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f491593e-deef-457f-af7a-0b34c9524de6-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666476 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-textfile\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666504 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46d1793-ddc0-4808-be95-c56171c83199-metrics-client-ca\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666520 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666561 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666601 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-tls\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666740 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-wtmp\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666784 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666811 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzgp2\" (UniqueName: \"kubernetes.io/projected/b46d1793-ddc0-4808-be95-c56171c83199-kube-api-access-vzgp2\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666842 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-accelerators-collector-config\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.666924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666900 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.667297 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666968 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqrmr\" (UniqueName: \"kubernetes.io/projected/f491593e-deef-457f-af7a-0b34c9524de6-kube-api-access-cqrmr\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.667297 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.666996 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f491593e-deef-457f-af7a-0b34c9524de6-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.667297 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.667010 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-sys\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.667297 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.667025 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-root\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.767892 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.767841 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqrmr\" (UniqueName: \"kubernetes.io/projected/f491593e-deef-457f-af7a-0b34c9524de6-kube-api-access-cqrmr\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.767892 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.767897 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f491593e-deef-457f-af7a-0b34c9524de6-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.768109 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.767920 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-sys\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768109 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.767937 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-root\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768109 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.767960 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f491593e-deef-457f-af7a-0b34c9524de6-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.768109 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.767987 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-textfile\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768109 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768007 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46d1793-ddc0-4808-be95-c56171c83199-metrics-client-ca\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768109 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768067 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-sys\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768109 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768093 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-root\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768119 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-tls\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-wtmp\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768260 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768287 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzgp2\" (UniqueName: \"kubernetes.io/projected/b46d1793-ddc0-4808-be95-c56171c83199-kube-api-access-vzgp2\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768326 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f491593e-deef-457f-af7a-0b34c9524de6-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:44.768348 2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768373 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-textfile\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-accelerators-collector-config\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:44.768407 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-tls podName:b46d1793-ddc0-4808-be95-c56171c83199 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:45.268389215 +0000 UTC m=+69.595766139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-tls") pod "node-exporter-jt9ml" (UID: "b46d1793-ddc0-4808-be95-c56171c83199") : secret "node-exporter-tls" not found Sep 11 08:47:44.768454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768448 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-wtmp\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.769145 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768630 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.769145 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768727 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b46d1793-ddc0-4808-be95-c56171c83199-metrics-client-ca\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.769145 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.768754 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f491593e-deef-457f-af7a-0b34c9524de6-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.769145 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.769109 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-accelerators-collector-config\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.769408 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.769197 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.770690 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.770660 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.770781 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.770711 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.770781 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.770768 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f491593e-deef-457f-af7a-0b34c9524de6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.776159 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.776136 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzgp2\" (UniqueName: \"kubernetes.io/projected/b46d1793-ddc0-4808-be95-c56171c83199-kube-api-access-vzgp2\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:44.776237 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.776222 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqrmr\" (UniqueName: \"kubernetes.io/projected/f491593e-deef-457f-af7a-0b34c9524de6-kube-api-access-cqrmr\") pod \"kube-state-metrics-59fbdd77d-v5nvg\" (UID: \"f491593e-deef-457f-af7a-0b34c9524de6\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:44.860962 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:44.860873 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" Sep 11 08:47:45.273274 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.273231 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-tls\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:45.275754 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.275727 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b46d1793-ddc0-4808-be95-c56171c83199-node-exporter-tls\") pod \"node-exporter-jt9ml\" (UID: \"b46d1793-ddc0-4808-be95-c56171c83199\") " pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:45.475861 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.475829 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jt9ml" Sep 11 08:47:45.599250 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.599150 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:47:45.625247 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.625216 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:47:45.625434 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.625361 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.627656 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.627623 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 08:47:45.627930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.627910 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 08:47:45.628065 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.628045 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 08:47:45.628162 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.628146 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 08:47:45.628238 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.628218 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 08:47:45.628326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.628311 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wvp59\"" Sep 11 08:47:45.628326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.628348 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 08:47:45.628326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.628229 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 08:47:45.628550 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.628314 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 08:47:45.628602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.628565 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 08:47:45.677094 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.676860 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677094 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.676934 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-web-config\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677094 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.676963 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677094 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.676999 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677094 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677049 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-config-out\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677094 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677091 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677898 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677128 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677898 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677157 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677898 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677184 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677898 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677207 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677898 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677233 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677898 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677270 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.677898 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.677321 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75jsf\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-kube-api-access-75jsf\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.777862 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.777820 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-web-config\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778046 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.777875 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778046 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.777937 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778046 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.777965 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-config-out\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778046 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778228 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778053 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778228 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778073 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778228 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778126 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778228 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778142 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778228 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778162 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778228 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778228 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778201 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75jsf\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-kube-api-access-75jsf\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.778468 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.778239 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.779922 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:45.779277 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle podName:fa2cf599-829f-4be9-b11c-1834225a7c67 nodeName:}" failed. No retries permitted until 2026-09-11 08:47:46.279251725 +0000 UTC m=+70.606628656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67") : configmap references non-existent config key: ca-bundle.crt Sep 11 08:47:45.779922 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.779464 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.779922 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.779639 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.781203 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.781151 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-web-config\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.782491 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.782463 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.782604 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.782514 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.783115 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.783076 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.783214 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.783173 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.783314 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.783292 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-config-volume\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.783369 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.783353 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.783544 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.783527 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-config-out\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.783824 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.783809 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:45.792310 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:45.792287 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75jsf\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-kube-api-access-75jsf\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:46.284056 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.284024 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:46.284812 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.284793 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:46.538138 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.538048 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:47:46.583637 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:46.583605 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46d1793_ddc0_4808_be95_c56171c83199.slice/crio-9c58829f0130666eb8b7175210e11d1748fb0ff019475acc1b31051c8cf10842 WatchSource:0}: Error finding container 9c58829f0130666eb8b7175210e11d1748fb0ff019475acc1b31051c8cf10842: Status 404 returned error can't find the container with id 9c58829f0130666eb8b7175210e11d1748fb0ff019475acc1b31051c8cf10842 Sep 11 08:47:46.595543 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.595510 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jt9ml" event={"ID":"b46d1793-ddc0-4808-be95-c56171c83199","Type":"ContainerStarted","Data":"9c58829f0130666eb8b7175210e11d1748fb0ff019475acc1b31051c8cf10842"} Sep 11 08:47:46.640209 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.640178 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66fbd67d86-wvjn2"] Sep 11 08:47:46.663228 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.663122 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.664000 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.662964 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fbd67d86-wvjn2"] Sep 11 08:47:46.668930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.666676 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 11 08:47:46.668930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.666998 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 11 08:47:46.668930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.667242 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 11 08:47:46.668930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.667459 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 11 08:47:46.668930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.667652 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2dk6f\"" Sep 11 08:47:46.668930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.667853 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ecueptrnsdmc0\"" Sep 11 08:47:46.668930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.668086 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 11 08:47:46.788502 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.788431 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-tls\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.788502 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.788475 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpbvm\" (UniqueName: \"kubernetes.io/projected/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-kube-api-access-qpbvm\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.789190 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.788542 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.789190 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.788597 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.789190 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.788617 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.789190 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.788674 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.789190 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.788693 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-metrics-client-ca\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.789190 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.788720 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-grpc-tls\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.857978 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.857916 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg"] Sep 11 08:47:46.861224 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:46.861187 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf491593e_deef_457f_af7a_0b34c9524de6.slice/crio-0befe4153e1db2db4fb7dc82d1f92428cc80e22e1dbd9a8b9168c0d4df501503 WatchSource:0}: Error finding container 0befe4153e1db2db4fb7dc82d1f92428cc80e22e1dbd9a8b9168c0d4df501503: Status 404 returned error can't find the container with id 0befe4153e1db2db4fb7dc82d1f92428cc80e22e1dbd9a8b9168c0d4df501503 Sep 11 08:47:46.877929 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.877897 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:47:46.881683 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:46.881661 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2cf599_829f_4be9_b11c_1834225a7c67.slice/crio-3c29c3005c91367414e9cf74e85c3378e31a016a310d12af14b210ba0cba1731 WatchSource:0}: Error finding container 3c29c3005c91367414e9cf74e85c3378e31a016a310d12af14b210ba0cba1731: Status 404 returned error can't find the container with id 3c29c3005c91367414e9cf74e85c3378e31a016a310d12af14b210ba0cba1731 Sep 11 08:47:46.889137 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.889113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-grpc-tls\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.889217 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.889178 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-tls\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.889217 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.889210 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpbvm\" (UniqueName: \"kubernetes.io/projected/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-kube-api-access-qpbvm\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.889305 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.889235 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.889502 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.889406 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.889502 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.889452 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.889658 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.889514 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.889658 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.889541 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-metrics-client-ca\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.890336 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.890291 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-metrics-client-ca\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.892437 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.892393 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.892577 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.892551 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-tls\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.892814 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.892783 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.893077 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.893058 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.893161 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.893083 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.894325 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.894300 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-secret-grpc-tls\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.897979 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.897959 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpbvm\" (UniqueName: \"kubernetes.io/projected/7902f41e-6ffa-4aa1-be4a-e573cdcd678f-kube-api-access-qpbvm\") pod \"thanos-querier-66fbd67d86-wvjn2\" (UID: \"7902f41e-6ffa-4aa1-be4a-e573cdcd678f\") " pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:46.980149 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:46.980109 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:47.270747 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.270549 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66fbd67d86-wvjn2"] Sep 11 08:47:47.273578 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:47.273543 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7902f41e_6ffa_4aa1_be4a_e573cdcd678f.slice/crio-a9336740121354ad00e4a3e56119a21fbddfd94de3c69ada123f5a9b935ddbb2 WatchSource:0}: Error finding container a9336740121354ad00e4a3e56119a21fbddfd94de3c69ada123f5a9b935ddbb2: Status 404 returned error can't find the container with id a9336740121354ad00e4a3e56119a21fbddfd94de3c69ada123f5a9b935ddbb2 Sep 11 08:47:47.602770 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.602731 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kgbhf" event={"ID":"c67f45da-f058-4d7c-91ad-486492813cb1","Type":"ContainerStarted","Data":"b722fcb111687bce1d4da6045277129a3bd9e9b82542298d8d2ce65cea5aca29"} Sep 11 08:47:47.603158 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.603125 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:47:47.605720 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.605393 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c2fvf" event={"ID":"5bd3198a-fe39-49bd-bce0-fc4930f5a1b5","Type":"ContainerStarted","Data":"805be782db4424c69aa5819de0f461ed01927a825bc942b85f57169b2eb3b3b7"} Sep 11 08:47:47.607040 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.606945 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" event={"ID":"7902f41e-6ffa-4aa1-be4a-e573cdcd678f","Type":"ContainerStarted","Data":"a9336740121354ad00e4a3e56119a21fbddfd94de3c69ada123f5a9b935ddbb2"} Sep 11 08:47:47.609185 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.609156 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerStarted","Data":"3c29c3005c91367414e9cf74e85c3378e31a016a310d12af14b210ba0cba1731"} Sep 11 08:47:47.610946 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.610860 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" event={"ID":"f491593e-deef-457f-af7a-0b34c9524de6","Type":"ContainerStarted","Data":"0befe4153e1db2db4fb7dc82d1f92428cc80e22e1dbd9a8b9168c0d4df501503"} Sep 11 08:47:47.625960 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.624707 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kgbhf" podStartSLOduration=66.309142374 podStartE2EDuration="1m11.624690372s" totalImagesPullingTime="5.315547998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:47.623124947 +0000 UTC m=+71.950501886" watchObservedRunningTime="2026-09-11 08:47:47.624690372 +0000 UTC m=+71.952067313" Sep 11 08:47:47.649641 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:47.649584 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c2fvf" podStartSLOduration=66.323864434 podStartE2EDuration="1m11.649562901s" totalImagesPullingTime="5.325698467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 08:46:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:47.648064911 +0000 UTC m=+71.975441851" watchObservedRunningTime="2026-09-11 08:47:47.649562901 +0000 UTC m=+71.976939841" Sep 11 08:47:48.618064 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:48.618033 2584 generic.go:356] "Generic (PLEG): container finished" podID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerID="9d2083776416035aaa2a99178225c8138d767766a38b61178bfb2780e8bc11cc" exitCode=0 Sep 11 08:47:48.618440 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:48.618164 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerDied","Data":"9d2083776416035aaa2a99178225c8138d767766a38b61178bfb2780e8bc11cc"} Sep 11 08:47:48.622402 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:48.622353 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" event={"ID":"f491593e-deef-457f-af7a-0b34c9524de6","Type":"ContainerStarted","Data":"0a620f9114a741089ceb0979d096d3d14a70e53517ebea4c016575bd665c735b"} Sep 11 08:47:48.622515 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:48.622416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" event={"ID":"f491593e-deef-457f-af7a-0b34c9524de6","Type":"ContainerStarted","Data":"2075ed8758829ef938999965860a87164ec9eebe4cc6372f540e0a461cef7444"} Sep 11 08:47:48.625780 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:48.625467 2584 generic.go:356] "Generic (PLEG): container finished" podID="b46d1793-ddc0-4808-be95-c56171c83199" containerID="0a3c2498f4262d3bc478a72aaf77c53fafd74f967bd84d00e953ffb23d89856f" exitCode=0 Sep 11 08:47:48.626819 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:48.626390 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jt9ml" event={"ID":"b46d1793-ddc0-4808-be95-c56171c83199","Type":"ContainerDied","Data":"0a3c2498f4262d3bc478a72aaf77c53fafd74f967bd84d00e953ffb23d89856f"} Sep 11 08:47:49.312910 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.312861 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn"] Sep 11 08:47:49.316947 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.316738 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:49.319690 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.319631 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 11 08:47:49.319813 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.319792 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-t4jsj\"" Sep 11 08:47:49.328808 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.328786 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn"] Sep 11 08:47:49.413196 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.413173 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5764916a-3155-491d-8750-b95da5e6fb1e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jcnvn\" (UID: \"5764916a-3155-491d-8750-b95da5e6fb1e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:49.413296 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.413217 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgrn\" (UniqueName: \"kubernetes.io/projected/5764916a-3155-491d-8750-b95da5e6fb1e-kube-api-access-hdgrn\") pod \"monitoring-plugin-5d85778b9d-jcnvn\" (UID: \"5764916a-3155-491d-8750-b95da5e6fb1e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:49.514172 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.514134 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5764916a-3155-491d-8750-b95da5e6fb1e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jcnvn\" (UID: \"5764916a-3155-491d-8750-b95da5e6fb1e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:49.514407 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.514198 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgrn\" (UniqueName: \"kubernetes.io/projected/5764916a-3155-491d-8750-b95da5e6fb1e-kube-api-access-hdgrn\") pod \"monitoring-plugin-5d85778b9d-jcnvn\" (UID: \"5764916a-3155-491d-8750-b95da5e6fb1e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:49.514407 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:49.514311 2584 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 11 08:47:49.514407 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:47:49.514398 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5764916a-3155-491d-8750-b95da5e6fb1e-monitoring-plugin-cert podName:5764916a-3155-491d-8750-b95da5e6fb1e nodeName:}" failed. No retries permitted until 2026-09-11 08:47:50.014375746 +0000 UTC m=+74.341752682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5764916a-3155-491d-8750-b95da5e6fb1e-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-jcnvn" (UID: "5764916a-3155-491d-8750-b95da5e6fb1e") : secret "monitoring-plugin-cert" not found Sep 11 08:47:49.522322 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.522297 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgrn\" (UniqueName: \"kubernetes.io/projected/5764916a-3155-491d-8750-b95da5e6fb1e-kube-api-access-hdgrn\") pod \"monitoring-plugin-5d85778b9d-jcnvn\" (UID: \"5764916a-3155-491d-8750-b95da5e6fb1e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:49.631856 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.631773 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" event={"ID":"7902f41e-6ffa-4aa1-be4a-e573cdcd678f","Type":"ContainerStarted","Data":"ca066bf4a4a8a2de68084de81824461a9a00559725dbab0b705f5580fe1851dc"} Sep 11 08:47:49.632276 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.631856 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" event={"ID":"7902f41e-6ffa-4aa1-be4a-e573cdcd678f","Type":"ContainerStarted","Data":"b154dbc80376e16ac29b944df1e6300dff78224012c6b9851a4379bf65a9e644"} Sep 11 08:47:49.632276 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.631921 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" event={"ID":"7902f41e-6ffa-4aa1-be4a-e573cdcd678f","Type":"ContainerStarted","Data":"9e40c2bcf01889d457dd03581324987068a4bd98d31a2ca4f69678d33117d32d"} Sep 11 08:47:49.634141 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.634114 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" event={"ID":"f491593e-deef-457f-af7a-0b34c9524de6","Type":"ContainerStarted","Data":"7aa364ad1862fe95051ed6837532048faec76d420394d50d75c7680b71192adf"} Sep 11 08:47:49.636253 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.636224 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jt9ml" event={"ID":"b46d1793-ddc0-4808-be95-c56171c83199","Type":"ContainerStarted","Data":"b30c9982d4bf152c68911d9ebedf5948adc130bd7e192357a7be9a8aeeb4d2ea"} Sep 11 08:47:49.636360 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.636268 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jt9ml" event={"ID":"b46d1793-ddc0-4808-be95-c56171c83199","Type":"ContainerStarted","Data":"204246c961237e71b117d1f25f0846d3be9392f10ed003fd43bd43ad9c039ed2"} Sep 11 08:47:49.655802 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.655510 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-v5nvg" podStartSLOduration=4.115270306 podStartE2EDuration="5.655492755s" totalImagesPullingTime="1.540222449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:49.654973376 +0000 UTC m=+73.982350314" watchObservedRunningTime="2026-09-11 08:47:49.655492755 +0000 UTC m=+73.982869689" Sep 11 08:47:49.673470 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:49.673417 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jt9ml" podStartSLOduration=3.780249448 podStartE2EDuration="5.673398303s" totalImagesPullingTime="1.809917008s" totalInitContainerRuntime="83.231847ms" isStatefulPod=true podCreationTimestamp="2026-09-11 08:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:49.672820149 +0000 UTC m=+74.000197095" watchObservedRunningTime="2026-09-11 08:47:49.673398303 +0000 UTC m=+74.000775242" Sep 11 08:47:50.018749 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.018711 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5764916a-3155-491d-8750-b95da5e6fb1e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jcnvn\" (UID: \"5764916a-3155-491d-8750-b95da5e6fb1e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:50.021102 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.021083 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5764916a-3155-491d-8750-b95da5e6fb1e-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-jcnvn\" (UID: \"5764916a-3155-491d-8750-b95da5e6fb1e\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:50.228710 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.228678 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:50.780847 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.780073 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:47:50.784643 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.784623 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.787800 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.787561 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 08:47:50.787800 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.787766 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 08:47:50.788020 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.787946 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.787766 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788228 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788356 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3abp08785s1tb\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788404 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788658 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788840 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788904 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788981 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788916 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.789042 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b4mqt\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788983 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788930 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 08:47:50.789400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.788989 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 08:47:50.801943 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.801219 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 08:47:50.805235 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.805109 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:47:50.827686 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.827662 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.827791 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.827704 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.827791 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.827747 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.827791 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.827774 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.827978 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.827797 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.827978 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.827839 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.827978 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.827864 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42zc\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-kube-api-access-r42zc\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.827978 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.827952 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828010 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828037 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828061 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828084 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828111 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828135 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828484 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828250 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828484 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828285 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828484 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828326 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828484 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828353 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828484 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828376 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.828484 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.828459 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.864401 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.863656 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn"] Sep 11 08:47:50.874450 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:50.874407 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5764916a_3155_491d_8750_b95da5e6fb1e.slice/crio-5221a1a8473f6ed75fc2044e628b787b2e1e0d9895e68e1ad386a20e22a39efa WatchSource:0}: Error finding container 5221a1a8473f6ed75fc2044e628b787b2e1e0d9895e68e1ad386a20e22a39efa: Status 404 returned error can't find the container with id 5221a1a8473f6ed75fc2044e628b787b2e1e0d9895e68e1ad386a20e22a39efa Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.928929 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.928979 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929006 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929035 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929068 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929142 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929178 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929205 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929257 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929283 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929307 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929352 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929378 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r42zc\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-kube-api-access-r42zc\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929413 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929450 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929475 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929501 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929524 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929550 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.929732 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.929548 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.932326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.931157 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.932326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.931364 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.932326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.931407 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.932326 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.932042 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.935600 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.932754 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.935600 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.933397 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.935600 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.935083 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-web-config\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.935600 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.935477 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config-out\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.935600 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.935501 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.935600 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.935557 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.936586 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.936097 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.936586 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.936424 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.936586 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.936546 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.937968 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.937266 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.937968 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.937639 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.937968 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.937915 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.938439 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.938419 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.940044 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.940025 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:50.941968 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:50.941933 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42zc\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-kube-api-access-r42zc\") pod \"prometheus-k8s-0\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:51.121829 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.121747 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:51.412155 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.412128 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:47:51.414281 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:47:51.414244 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3cad9f_e064_4eaf_b6f6_4518ed609f27.slice/crio-cae1a60c3bd85a1e2182180248b72982bc146e8fdb168c7f65b20bbed7c07999 WatchSource:0}: Error finding container cae1a60c3bd85a1e2182180248b72982bc146e8fdb168c7f65b20bbed7c07999: Status 404 returned error can't find the container with id cae1a60c3bd85a1e2182180248b72982bc146e8fdb168c7f65b20bbed7c07999 Sep 11 08:47:51.649926 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.649896 2584 generic.go:356] "Generic (PLEG): container finished" podID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" exitCode=0 Sep 11 08:47:51.650105 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.649993 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerDied","Data":"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a"} Sep 11 08:47:51.650105 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.650087 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerStarted","Data":"cae1a60c3bd85a1e2182180248b72982bc146e8fdb168c7f65b20bbed7c07999"} Sep 11 08:47:51.651317 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.651277 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" event={"ID":"5764916a-3155-491d-8750-b95da5e6fb1e","Type":"ContainerStarted","Data":"5221a1a8473f6ed75fc2044e628b787b2e1e0d9895e68e1ad386a20e22a39efa"} Sep 11 08:47:51.654609 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.654585 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" event={"ID":"7902f41e-6ffa-4aa1-be4a-e573cdcd678f","Type":"ContainerStarted","Data":"a247d184431dcc0c5150baffcce3213e753390820ce956b848b98a9f295ad918"} Sep 11 08:47:51.654693 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.654649 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" event={"ID":"7902f41e-6ffa-4aa1-be4a-e573cdcd678f","Type":"ContainerStarted","Data":"b97bdf64bbf04a0799305b0a5ca72dfd1043a07fedde58e3474b57a8cf0bdb46"} Sep 11 08:47:51.654760 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.654692 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" event={"ID":"7902f41e-6ffa-4aa1-be4a-e573cdcd678f","Type":"ContainerStarted","Data":"c1361681cbe8ffb982c2696d4aa1e6f8c8555b3dfd4b0c1cf551c6c99706980f"} Sep 11 08:47:51.654760 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.654727 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:47:51.658148 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.658129 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerStarted","Data":"d9a30c1005c2be8eebd27c278f028224ec605c998ac05900cf30f835c09076bd"} Sep 11 08:47:51.658223 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.658177 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerStarted","Data":"4249dd9491902f8304675df8e381cfc9dea3d38b6ce8e4bd5cd0db11c7d485d4"} Sep 11 08:47:51.658223 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.658205 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerStarted","Data":"31ee1de72eae5cae376c48131500c157860df00ceb2178c2f7ee3194831561d1"} Sep 11 08:47:51.658303 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.658237 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerStarted","Data":"bb99c14684be85b4dc7188619cc45db144de878b6b01fa080725a7877af3e430"} Sep 11 08:47:51.658303 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.658261 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerStarted","Data":"191e4ac210c952c4326cc2db9aa00b6e0f102e2c35cfd4ce29eb09bf528171cb"} Sep 11 08:47:51.658361 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.658315 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerStarted","Data":"db978bd4ad5f23cb354327a715697e93308ed2f1d1740996b7cbfc9db014e12c"} Sep 11 08:47:51.705220 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.705110 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.207639837 podStartE2EDuration="6.705087677s" totalImagesPullingTime="3.475688632s" totalInitContainerRuntime="21.759208ms" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:51.703471166 +0000 UTC m=+76.030848117" watchObservedRunningTime="2026-09-11 08:47:51.705087677 +0000 UTC m=+76.032464617" Sep 11 08:47:51.724513 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:51.724433 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" podStartSLOduration=2.621021025 podStartE2EDuration="5.724395467s" totalImagesPullingTime="3.103374442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:51.722590926 +0000 UTC m=+76.049967865" watchObservedRunningTime="2026-09-11 08:47:51.724395467 +0000 UTC m=+76.051772407" Sep 11 08:47:52.664941 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:52.664858 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" event={"ID":"5764916a-3155-491d-8750-b95da5e6fb1e","Type":"ContainerStarted","Data":"32fb8f50ba0c42de8b31648d7dc2f1f678ca69b3d8b5dc62d25422da9c3262c5"} Sep 11 08:47:52.666025 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:52.665989 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:52.671092 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:52.671067 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" Sep 11 08:47:52.680553 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:52.680511 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-jcnvn" podStartSLOduration=2.419948604 podStartE2EDuration="3.680496764s" totalImagesPullingTime="1.26054816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:52.678780582 +0000 UTC m=+77.006157522" watchObservedRunningTime="2026-09-11 08:47:52.680496764 +0000 UTC m=+77.007873703" Sep 11 08:47:55.681958 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:55.681915 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerStarted","Data":"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d"} Sep 11 08:47:55.682410 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:55.682020 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerStarted","Data":"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164"} Sep 11 08:47:55.682410 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:55.682056 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerStarted","Data":"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25"} Sep 11 08:47:55.682410 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:55.682084 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerStarted","Data":"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9"} Sep 11 08:47:55.682410 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:55.682107 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerStarted","Data":"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e"} Sep 11 08:47:55.682410 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:55.682130 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerStarted","Data":"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9"} Sep 11 08:47:55.749600 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:55.749539 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.482714568 podStartE2EDuration="5.749512257s" totalImagesPullingTime="3.242498829s" totalInitContainerRuntime="24.29886ms" isStatefulPod=false podCreationTimestamp="2026-09-11 08:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:47:55.744445718 +0000 UTC m=+80.071822658" watchObservedRunningTime="2026-09-11 08:47:55.749512257 +0000 UTC m=+80.076889197" Sep 11 08:47:56.121984 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:56.121895 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:47:57.547985 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:57.547951 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7976d8b549-hcg2g" Sep 11 08:47:57.670662 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:47:57.670634 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66fbd67d86-wvjn2" Sep 11 08:48:18.629250 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:48:18.629219 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kgbhf" Sep 11 08:48:51.122672 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:48:51.122636 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:48:51.142481 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:48:51.142456 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:48:51.917619 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:48:51.917584 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:04.814887 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.814835 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:49:04.815409 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.815142 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="alertmanager" containerID="cri-o://db978bd4ad5f23cb354327a715697e93308ed2f1d1740996b7cbfc9db014e12c" gracePeriod=120 Sep 11 08:49:04.815409 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.815160 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="prom-label-proxy" containerID="cri-o://d9a30c1005c2be8eebd27c278f028224ec605c998ac05900cf30f835c09076bd" gracePeriod=120 Sep 11 08:49:04.815409 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.815201 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy-web" containerID="cri-o://bb99c14684be85b4dc7188619cc45db144de878b6b01fa080725a7877af3e430" gracePeriod=120 Sep 11 08:49:04.815409 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.815193 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy" containerID="cri-o://31ee1de72eae5cae376c48131500c157860df00ceb2178c2f7ee3194831561d1" gracePeriod=120 Sep 11 08:49:04.815409 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.815217 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="config-reloader" containerID="cri-o://191e4ac210c952c4326cc2db9aa00b6e0f102e2c35cfd4ce29eb09bf528171cb" gracePeriod=120 Sep 11 08:49:04.815409 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.815251 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy-metric" containerID="cri-o://4249dd9491902f8304675df8e381cfc9dea3d38b6ce8e4bd5cd0db11c7d485d4" gracePeriod=120 Sep 11 08:49:04.956336 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.956310 2584 generic.go:356] "Generic (PLEG): container finished" podID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerID="d9a30c1005c2be8eebd27c278f028224ec605c998ac05900cf30f835c09076bd" exitCode=0 Sep 11 08:49:04.956336 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.956333 2584 generic.go:356] "Generic (PLEG): container finished" podID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerID="31ee1de72eae5cae376c48131500c157860df00ceb2178c2f7ee3194831561d1" exitCode=0 Sep 11 08:49:04.956336 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.956339 2584 generic.go:356] "Generic (PLEG): container finished" podID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerID="191e4ac210c952c4326cc2db9aa00b6e0f102e2c35cfd4ce29eb09bf528171cb" exitCode=0 Sep 11 08:49:04.956502 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.956345 2584 generic.go:356] "Generic (PLEG): container finished" podID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerID="db978bd4ad5f23cb354327a715697e93308ed2f1d1740996b7cbfc9db014e12c" exitCode=0 Sep 11 08:49:04.956502 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.956379 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerDied","Data":"d9a30c1005c2be8eebd27c278f028224ec605c998ac05900cf30f835c09076bd"} Sep 11 08:49:04.956502 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.956465 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerDied","Data":"31ee1de72eae5cae376c48131500c157860df00ceb2178c2f7ee3194831561d1"} Sep 11 08:49:04.956502 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.956492 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerDied","Data":"191e4ac210c952c4326cc2db9aa00b6e0f102e2c35cfd4ce29eb09bf528171cb"} Sep 11 08:49:04.956617 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:04.956516 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerDied","Data":"db978bd4ad5f23cb354327a715697e93308ed2f1d1740996b7cbfc9db014e12c"} Sep 11 08:49:05.964372 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:05.964330 2584 generic.go:356] "Generic (PLEG): container finished" podID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerID="4249dd9491902f8304675df8e381cfc9dea3d38b6ce8e4bd5cd0db11c7d485d4" exitCode=0 Sep 11 08:49:05.964372 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:05.964367 2584 generic.go:356] "Generic (PLEG): container finished" podID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerID="bb99c14684be85b4dc7188619cc45db144de878b6b01fa080725a7877af3e430" exitCode=0 Sep 11 08:49:05.964833 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:05.964438 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerDied","Data":"4249dd9491902f8304675df8e381cfc9dea3d38b6ce8e4bd5cd0db11c7d485d4"} Sep 11 08:49:05.964833 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:05.964510 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerDied","Data":"bb99c14684be85b4dc7188619cc45db144de878b6b01fa080725a7877af3e430"} Sep 11 08:49:06.066096 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.066072 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:06.088074 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088049 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-main-tls\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088197 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088080 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-metrics-client-ca\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088197 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088101 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-web\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088197 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088122 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088397 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088236 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-config-out\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088397 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088285 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-cluster-tls-config\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088397 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088331 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-main-db\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088397 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088361 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75jsf\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-kube-api-access-75jsf\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088397 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088388 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088763 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088426 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-config-volume\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088763 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088450 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088763 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088488 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:06.088763 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088507 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-tls-assets\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.088763 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088572 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-web-config\") pod \"fa2cf599-829f-4be9-b11c-1834225a7c67\" (UID: \"fa2cf599-829f-4be9-b11c-1834225a7c67\") " Sep 11 08:49:06.089051 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.088848 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-metrics-client-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.091927 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.091717 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:49:06.093894 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.092197 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:06.093894 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.092828 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:06.093894 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.093001 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:49:06.093894 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.093009 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:06.094924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.094891 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:06.095071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.095052 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-config-out" (OuterVolumeSpecName: "config-out") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:49:06.095560 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.095532 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:06.095717 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.095635 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-config-volume" (OuterVolumeSpecName: "config-volume") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:06.097036 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.097000 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-kube-api-access-75jsf" (OuterVolumeSpecName: "kube-api-access-75jsf") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "kube-api-access-75jsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:49:06.101227 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.101193 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:06.110022 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.109928 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-web-config" (OuterVolumeSpecName: "web-config") pod "fa2cf599-829f-4be9-b11c-1834225a7c67" (UID: "fa2cf599-829f-4be9-b11c-1834225a7c67"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:06.189389 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189355 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-config-out\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189389 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189384 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-cluster-tls-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189389 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189398 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-main-db\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189408 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75jsf\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-kube-api-access-75jsf\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189418 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa2cf599-829f-4be9-b11c-1834225a7c67-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189428 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-config-volume\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189436 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189444 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa2cf599-829f-4be9-b11c-1834225a7c67-tls-assets\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189452 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-web-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189464 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-main-tls\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189476 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.189602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.189485 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fa2cf599-829f-4be9-b11c-1834225a7c67-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:06.971577 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.971544 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fa2cf599-829f-4be9-b11c-1834225a7c67","Type":"ContainerDied","Data":"3c29c3005c91367414e9cf74e85c3378e31a016a310d12af14b210ba0cba1731"} Sep 11 08:49:06.971577 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.971580 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:06.972021 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.971621 2584 scope.go:117] "RemoveContainer" containerID="d9a30c1005c2be8eebd27c278f028224ec605c998ac05900cf30f835c09076bd" Sep 11 08:49:06.979144 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.979123 2584 scope.go:117] "RemoveContainer" containerID="4249dd9491902f8304675df8e381cfc9dea3d38b6ce8e4bd5cd0db11c7d485d4" Sep 11 08:49:06.986400 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.986384 2584 scope.go:117] "RemoveContainer" containerID="31ee1de72eae5cae376c48131500c157860df00ceb2178c2f7ee3194831561d1" Sep 11 08:49:06.991166 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.991132 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:49:06.995005 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.994989 2584 scope.go:117] "RemoveContainer" containerID="bb99c14684be85b4dc7188619cc45db144de878b6b01fa080725a7877af3e430" Sep 11 08:49:06.998957 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:06.998934 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:49:07.002182 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.002168 2584 scope.go:117] "RemoveContainer" containerID="191e4ac210c952c4326cc2db9aa00b6e0f102e2c35cfd4ce29eb09bf528171cb" Sep 11 08:49:07.008893 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.008865 2584 scope.go:117] "RemoveContainer" containerID="db978bd4ad5f23cb354327a715697e93308ed2f1d1740996b7cbfc9db014e12c" Sep 11 08:49:07.015930 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.015911 2584 scope.go:117] "RemoveContainer" containerID="9d2083776416035aaa2a99178225c8138d767766a38b61178bfb2780e8bc11cc" Sep 11 08:49:07.023300 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023281 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:49:07.023608 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023593 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="alertmanager" Sep 11 08:49:07.023682 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023612 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="alertmanager" Sep 11 08:49:07.023682 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023631 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="config-reloader" Sep 11 08:49:07.023682 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023639 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="config-reloader" Sep 11 08:49:07.023682 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023659 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy-web" Sep 11 08:49:07.023682 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023669 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy-web" Sep 11 08:49:07.023682 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023678 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="prom-label-proxy" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023686 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="prom-label-proxy" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023704 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023713 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023720 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy-metric" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023731 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy-metric" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023751 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="init-config-reloader" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023759 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="init-config-reloader" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023831 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy-web" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023843 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="alertmanager" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023853 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023863 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="config-reloader" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023870 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="kube-rbac-proxy-metric" Sep 11 08:49:07.024060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.023898 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" containerName="prom-label-proxy" Sep 11 08:49:07.027497 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.027478 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.029784 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.029574 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 11 08:49:07.029784 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.029649 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wvp59\"" Sep 11 08:49:07.029784 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.029576 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 11 08:49:07.029784 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.029576 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 11 08:49:07.029784 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.029785 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 11 08:49:07.030091 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.029812 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 11 08:49:07.030158 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.030138 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 11 08:49:07.030974 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.030870 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 11 08:49:07.031121 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.031102 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 11 08:49:07.037012 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.036957 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 11 08:49:07.041382 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.041361 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:49:07.095870 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.095832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.095870 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.095870 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg97j\" (UniqueName: \"kubernetes.io/projected/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-kube-api-access-tg97j\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096105 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.095947 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096105 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.095981 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096105 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096011 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096105 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096048 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096105 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096094 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096260 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096155 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096260 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096260 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096244 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-web-config\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096394 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096278 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-config-out\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096394 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096296 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.096394 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.096349 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197393 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197355 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197573 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197399 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197573 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197424 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg97j\" (UniqueName: \"kubernetes.io/projected/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-kube-api-access-tg97j\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197573 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197466 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197573 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197530 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197573 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197556 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197597 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197655 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197680 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197705 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-web-config\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-config-out\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197765 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.197840 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.197814 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.198669 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.198641 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.199639 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.199603 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.200530 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.200502 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.201096 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.200684 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.201096 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.200798 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.201096 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.201029 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.201096 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.201045 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.201096 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.201055 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.201407 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.201351 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-web-config\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.202056 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.202036 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.202299 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.202282 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-config-out\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.204538 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.204516 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg97j\" (UniqueName: \"kubernetes.io/projected/3e8894bf-0f6b-4cd2-9af3-c98b52a62aad-kube-api-access-tg97j\") pod \"alertmanager-main-0\" (UID: \"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad\") " pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.340773 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.340738 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 11 08:49:07.635870 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.635840 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 11 08:49:07.637755 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:49:07.637733 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8894bf_0f6b_4cd2_9af3_c98b52a62aad.slice/crio-a9a3f0eda41c36d41e3b486bda90f4c8f1f803fd663f285d66d2e59aaee44ac7 WatchSource:0}: Error finding container a9a3f0eda41c36d41e3b486bda90f4c8f1f803fd663f285d66d2e59aaee44ac7: Status 404 returned error can't find the container with id a9a3f0eda41c36d41e3b486bda90f4c8f1f803fd663f285d66d2e59aaee44ac7 Sep 11 08:49:07.977645 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.977605 2584 generic.go:356] "Generic (PLEG): container finished" podID="3e8894bf-0f6b-4cd2-9af3-c98b52a62aad" containerID="391e88882b9032669c82b8f4d65bb84772f834a7a081925ee1c37e433d50d5b6" exitCode=0 Sep 11 08:49:07.977645 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.977646 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad","Type":"ContainerDied","Data":"391e88882b9032669c82b8f4d65bb84772f834a7a081925ee1c37e433d50d5b6"} Sep 11 08:49:07.978200 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:07.977704 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad","Type":"ContainerStarted","Data":"a9a3f0eda41c36d41e3b486bda90f4c8f1f803fd663f285d66d2e59aaee44ac7"} Sep 11 08:49:08.139924 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:08.139898 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa2cf599-829f-4be9-b11c-1834225a7c67" path="/var/lib/kubelet/pods/fa2cf599-829f-4be9-b11c-1834225a7c67/volumes" Sep 11 08:49:08.986667 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:08.986632 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad","Type":"ContainerStarted","Data":"ab0fdb64eff733bce9b86793959c95591d5049c66766183d66b5b1b394b053bd"} Sep 11 08:49:08.987054 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:08.986698 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad","Type":"ContainerStarted","Data":"a2b392c5c9c8ad2f1d008feca3351b198818b28050cd20ee60717d0b4cb0d32b"} Sep 11 08:49:08.987054 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:08.986724 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad","Type":"ContainerStarted","Data":"4ad596b6f19cd5ea5c85ca3c15793822c79fb70f57dc61742f5a3f48671f206f"} Sep 11 08:49:08.987054 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:08.986750 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad","Type":"ContainerStarted","Data":"960ff6734f6c8df85784256381f34917b2a23ace76ae1de70a1b01b651c65a5e"} Sep 11 08:49:08.987054 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:08.986774 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad","Type":"ContainerStarted","Data":"90136ff39ddb8d6f09dbc72365b5396fe51348624097a843e2d7470fbf0909f4"} Sep 11 08:49:08.987054 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:08.986796 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e8894bf-0f6b-4cd2-9af3-c98b52a62aad","Type":"ContainerStarted","Data":"af295c08bcaa8a7af8a1f9be9642122b23566c49a004de80e96c64bd0b071d06"} Sep 11 08:49:09.015647 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.015588 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.000158984 podStartE2EDuration="2.015571092s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.412108ms" isStatefulPod=false podCreationTimestamp="2026-09-11 08:49:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:49:09.013800913 +0000 UTC m=+153.341177875" watchObservedRunningTime="2026-09-11 08:49:09.015571092 +0000 UTC m=+153.342948078" Sep 11 08:49:09.161992 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.161953 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:49:09.162325 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.162290 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="prometheus" containerID="cri-o://a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" gracePeriod=600 Sep 11 08:49:09.162416 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.162305 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy" containerID="cri-o://25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" gracePeriod=600 Sep 11 08:49:09.162416 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.162328 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" gracePeriod=600 Sep 11 08:49:09.162416 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.162368 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="config-reloader" containerID="cri-o://109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" gracePeriod=600 Sep 11 08:49:09.162568 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.162341 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy-web" containerID="cri-o://1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" gracePeriod=600 Sep 11 08:49:09.162568 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.162502 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="thanos-sidecar" containerID="cri-o://149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" gracePeriod=600 Sep 11 08:49:09.400352 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.400325 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:09.418427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418391 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-0\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.418427 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418430 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config-out\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.418652 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418455 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-2\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.418652 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418486 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.418652 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418520 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-tls\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.418652 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418578 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-metrics-client-ca\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.418652 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418605 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-serving-certs-ca-bundle\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.418652 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418628 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-grpc-tls\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418670 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418696 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418729 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-tls-assets\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418766 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-db\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418794 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-web-config\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418815 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418838 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-trusted-ca-bundle\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418873 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-1\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418915 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-metrics-client-certs\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418949 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-kube-rbac-proxy\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.418949 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419000 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-thanos-prometheus-http-client-file\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419033 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-kubelet-serving-ca-bundle\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419058 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419057 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r42zc\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-kube-api-access-r42zc\") pod \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\" (UID: \"1e3cad9f-e064-4eaf-b6f6-4518ed609f27\") " Sep 11 08:49:09.419734 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419262 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:09.419734 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419375 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.419734 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419394 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-metrics-client-ca\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.419734 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419410 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.419734 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419518 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:09.419997 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.419821 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:09.420605 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.420296 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:09.421390 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.421347 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.421639 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.421610 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 08:49:09.423003 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.422976 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config" (OuterVolumeSpecName: "config") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.423129 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.423105 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-kube-api-access-r42zc" (OuterVolumeSpecName: "kube-api-access-r42zc") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "kube-api-access-r42zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:49:09.423129 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.423114 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:49:09.423344 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.423319 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.423555 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.423530 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.423643 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.423604 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.424065 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.424029 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.424165 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.424085 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config-out" (OuterVolumeSpecName: "config-out") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 08:49:09.424538 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.424516 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 08:49:09.424744 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.424720 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.425241 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.425212 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.435819 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.435790 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-web-config" (OuterVolumeSpecName: "web-config") pod "1e3cad9f-e064-4eaf-b6f6-4518ed609f27" (UID: "1e3cad9f-e064-4eaf-b6f6-4518ed609f27"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 08:49:09.520231 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520199 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520231 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520230 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520242 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r42zc\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-kube-api-access-r42zc\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520256 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520269 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config-out\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520283 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520296 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520308 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-grpc-tls\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520318 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520329 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520341 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-tls-assets\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520352 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-db\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520363 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-web-config\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520375 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520386 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520400 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-metrics-client-certs\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.520454 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.520412 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1e3cad9f-e064-4eaf-b6f6-4518ed609f27-secret-kube-rbac-proxy\") on node \"ip-10-0-138-35.ec2.internal\" DevicePath \"\"" Sep 11 08:49:09.994381 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994345 2584 generic.go:356] "Generic (PLEG): container finished" podID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" exitCode=0 Sep 11 08:49:09.994381 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994376 2584 generic.go:356] "Generic (PLEG): container finished" podID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" exitCode=0 Sep 11 08:49:09.994381 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994384 2584 generic.go:356] "Generic (PLEG): container finished" podID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" exitCode=0 Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994396 2584 generic.go:356] "Generic (PLEG): container finished" podID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" exitCode=0 Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994407 2584 generic.go:356] "Generic (PLEG): container finished" podID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" exitCode=0 Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994417 2584 generic.go:356] "Generic (PLEG): container finished" podID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" exitCode=0 Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994430 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerDied","Data":"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d"} Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994447 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994499 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerDied","Data":"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164"} Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994528 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerDied","Data":"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25"} Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994555 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerDied","Data":"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9"} Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994579 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerDied","Data":"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e"} Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994606 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerDied","Data":"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9"} Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994629 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1e3cad9f-e064-4eaf-b6f6-4518ed609f27","Type":"ContainerDied","Data":"cae1a60c3bd85a1e2182180248b72982bc146e8fdb168c7f65b20bbed7c07999"} Sep 11 08:49:09.994906 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:09.994578 2584 scope.go:117] "RemoveContainer" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" Sep 11 08:49:10.002377 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.002353 2584 scope.go:117] "RemoveContainer" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" Sep 11 08:49:10.009564 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.009543 2584 scope.go:117] "RemoveContainer" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" Sep 11 08:49:10.016130 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.016113 2584 scope.go:117] "RemoveContainer" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" Sep 11 08:49:10.021160 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.021140 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:49:10.024190 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.024168 2584 scope.go:117] "RemoveContainer" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" Sep 11 08:49:10.025990 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.025968 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:49:10.033583 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.033561 2584 scope.go:117] "RemoveContainer" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" Sep 11 08:49:10.041226 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.041108 2584 scope.go:117] "RemoveContainer" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" Sep 11 08:49:10.047753 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.047736 2584 scope.go:117] "RemoveContainer" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" Sep 11 08:49:10.048036 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:49:10.048017 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": container with ID starting with c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d not found: ID does not exist" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" Sep 11 08:49:10.048092 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.048043 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d"} err="failed to get container status \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": rpc error: code = NotFound desc = could not find container \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": container with ID starting with c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d not found: ID does not exist" Sep 11 08:49:10.048092 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.048073 2584 scope.go:117] "RemoveContainer" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" Sep 11 08:49:10.048327 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:49:10.048311 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": container with ID starting with 25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164 not found: ID does not exist" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" Sep 11 08:49:10.048395 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.048331 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164"} err="failed to get container status \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": rpc error: code = NotFound desc = could not find container \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": container with ID starting with 25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164 not found: ID does not exist" Sep 11 08:49:10.048395 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.048344 2584 scope.go:117] "RemoveContainer" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" Sep 11 08:49:10.048562 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:49:10.048545 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": container with ID starting with 1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25 not found: ID does not exist" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" Sep 11 08:49:10.048602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.048565 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25"} err="failed to get container status \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": rpc error: code = NotFound desc = could not find container \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": container with ID starting with 1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25 not found: ID does not exist" Sep 11 08:49:10.048602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.048577 2584 scope.go:117] "RemoveContainer" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" Sep 11 08:49:10.048783 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:49:10.048762 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": container with ID starting with 149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9 not found: ID does not exist" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" Sep 11 08:49:10.048819 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.048792 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9"} err="failed to get container status \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": rpc error: code = NotFound desc = could not find container \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": container with ID starting with 149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9 not found: ID does not exist" Sep 11 08:49:10.048819 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.048805 2584 scope.go:117] "RemoveContainer" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" Sep 11 08:49:10.049255 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:49:10.049229 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": container with ID starting with 109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e not found: ID does not exist" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" Sep 11 08:49:10.049353 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.049270 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e"} err="failed to get container status \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": rpc error: code = NotFound desc = could not find container \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": container with ID starting with 109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e not found: ID does not exist" Sep 11 08:49:10.049353 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.049290 2584 scope.go:117] "RemoveContainer" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" Sep 11 08:49:10.049729 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:49:10.049700 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": container with ID starting with a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9 not found: ID does not exist" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" Sep 11 08:49:10.049806 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.049734 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9"} err="failed to get container status \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": rpc error: code = NotFound desc = could not find container \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": container with ID starting with a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9 not found: ID does not exist" Sep 11 08:49:10.049806 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.049763 2584 scope.go:117] "RemoveContainer" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" Sep 11 08:49:10.050115 ip-10-0-138-35 kubenswrapper[2584]: E0911 08:49:10.050090 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": container with ID starting with 0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a not found: ID does not exist" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" Sep 11 08:49:10.050173 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.050121 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a"} err="failed to get container status \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": rpc error: code = NotFound desc = could not find container \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": container with ID starting with 0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a not found: ID does not exist" Sep 11 08:49:10.050173 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.050139 2584 scope.go:117] "RemoveContainer" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" Sep 11 08:49:10.050431 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.050403 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d"} err="failed to get container status \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": rpc error: code = NotFound desc = could not find container \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": container with ID starting with c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d not found: ID does not exist" Sep 11 08:49:10.050485 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.050433 2584 scope.go:117] "RemoveContainer" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" Sep 11 08:49:10.050701 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.050677 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164"} err="failed to get container status \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": rpc error: code = NotFound desc = could not find container \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": container with ID starting with 25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164 not found: ID does not exist" Sep 11 08:49:10.050701 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.050700 2584 scope.go:117] "RemoveContainer" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" Sep 11 08:49:10.050953 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.050931 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25"} err="failed to get container status \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": rpc error: code = NotFound desc = could not find container \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": container with ID starting with 1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25 not found: ID does not exist" Sep 11 08:49:10.050996 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.050954 2584 scope.go:117] "RemoveContainer" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" Sep 11 08:49:10.051207 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051189 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:49:10.051207 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051199 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9"} err="failed to get container status \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": rpc error: code = NotFound desc = could not find container \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": container with ID starting with 149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9 not found: ID does not exist" Sep 11 08:49:10.051300 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051215 2584 scope.go:117] "RemoveContainer" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" Sep 11 08:49:10.051465 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051449 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e"} err="failed to get container status \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": rpc error: code = NotFound desc = could not find container \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": container with ID starting with 109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e not found: ID does not exist" Sep 11 08:49:10.051515 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051474 2584 scope.go:117] "RemoveContainer" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" Sep 11 08:49:10.051515 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051496 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="prometheus" Sep 11 08:49:10.051515 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051508 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="prometheus" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051524 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="config-reloader" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051532 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="config-reloader" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051540 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051546 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051554 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="init-config-reloader" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051559 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="init-config-reloader" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051565 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="thanos-sidecar" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051570 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="thanos-sidecar" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051580 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy-thanos" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051585 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy-thanos" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051593 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy-web" Sep 11 08:49:10.051610 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051603 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy-web" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051654 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy-web" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051661 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051669 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="kube-rbac-proxy-thanos" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051678 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="config-reloader" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051686 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="prometheus" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051692 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" containerName="thanos-sidecar" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051698 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9"} err="failed to get container status \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": rpc error: code = NotFound desc = could not find container \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": container with ID starting with a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9 not found: ID does not exist" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051714 2584 scope.go:117] "RemoveContainer" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051931 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a"} err="failed to get container status \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": rpc error: code = NotFound desc = could not find container \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": container with ID starting with 0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a not found: ID does not exist" Sep 11 08:49:10.051993 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.051943 2584 scope.go:117] "RemoveContainer" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" Sep 11 08:49:10.052405 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.052172 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d"} err="failed to get container status \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": rpc error: code = NotFound desc = could not find container \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": container with ID starting with c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d not found: ID does not exist" Sep 11 08:49:10.052405 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.052187 2584 scope.go:117] "RemoveContainer" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" Sep 11 08:49:10.052466 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.052417 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164"} err="failed to get container status \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": rpc error: code = NotFound desc = could not find container \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": container with ID starting with 25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164 not found: ID does not exist" Sep 11 08:49:10.052466 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.052430 2584 scope.go:117] "RemoveContainer" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" Sep 11 08:49:10.052669 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.052644 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25"} err="failed to get container status \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": rpc error: code = NotFound desc = could not find container \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": container with ID starting with 1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25 not found: ID does not exist" Sep 11 08:49:10.052711 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.052671 2584 scope.go:117] "RemoveContainer" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" Sep 11 08:49:10.052960 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.052938 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9"} err="failed to get container status \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": rpc error: code = NotFound desc = could not find container \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": container with ID starting with 149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9 not found: ID does not exist" Sep 11 08:49:10.053006 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.052961 2584 scope.go:117] "RemoveContainer" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" Sep 11 08:49:10.053193 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.053171 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e"} err="failed to get container status \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": rpc error: code = NotFound desc = could not find container \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": container with ID starting with 109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e not found: ID does not exist" Sep 11 08:49:10.053236 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.053195 2584 scope.go:117] "RemoveContainer" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" Sep 11 08:49:10.053444 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.053424 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9"} err="failed to get container status \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": rpc error: code = NotFound desc = could not find container \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": container with ID starting with a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9 not found: ID does not exist" Sep 11 08:49:10.053444 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.053443 2584 scope.go:117] "RemoveContainer" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" Sep 11 08:49:10.053728 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.053697 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a"} err="failed to get container status \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": rpc error: code = NotFound desc = could not find container \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": container with ID starting with 0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a not found: ID does not exist" Sep 11 08:49:10.053800 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.053730 2584 scope.go:117] "RemoveContainer" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" Sep 11 08:49:10.053991 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.053975 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d"} err="failed to get container status \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": rpc error: code = NotFound desc = could not find container \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": container with ID starting with c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d not found: ID does not exist" Sep 11 08:49:10.054039 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.053991 2584 scope.go:117] "RemoveContainer" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" Sep 11 08:49:10.054246 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.054220 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164"} err="failed to get container status \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": rpc error: code = NotFound desc = could not find container \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": container with ID starting with 25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164 not found: ID does not exist" Sep 11 08:49:10.054294 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.054246 2584 scope.go:117] "RemoveContainer" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" Sep 11 08:49:10.054476 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.054458 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25"} err="failed to get container status \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": rpc error: code = NotFound desc = could not find container \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": container with ID starting with 1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25 not found: ID does not exist" Sep 11 08:49:10.054476 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.054475 2584 scope.go:117] "RemoveContainer" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" Sep 11 08:49:10.054686 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.054665 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9"} err="failed to get container status \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": rpc error: code = NotFound desc = could not find container \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": container with ID starting with 149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9 not found: ID does not exist" Sep 11 08:49:10.054761 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.054687 2584 scope.go:117] "RemoveContainer" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" Sep 11 08:49:10.054917 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.054900 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e"} err="failed to get container status \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": rpc error: code = NotFound desc = could not find container \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": container with ID starting with 109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e not found: ID does not exist" Sep 11 08:49:10.054971 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.054916 2584 scope.go:117] "RemoveContainer" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" Sep 11 08:49:10.055141 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055123 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9"} err="failed to get container status \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": rpc error: code = NotFound desc = could not find container \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": container with ID starting with a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9 not found: ID does not exist" Sep 11 08:49:10.055213 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055144 2584 scope.go:117] "RemoveContainer" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" Sep 11 08:49:10.055368 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055351 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a"} err="failed to get container status \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": rpc error: code = NotFound desc = could not find container \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": container with ID starting with 0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a not found: ID does not exist" Sep 11 08:49:10.055434 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055369 2584 scope.go:117] "RemoveContainer" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" Sep 11 08:49:10.055592 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055565 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.055632 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055587 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d"} err="failed to get container status \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": rpc error: code = NotFound desc = could not find container \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": container with ID starting with c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d not found: ID does not exist" Sep 11 08:49:10.055632 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055602 2584 scope.go:117] "RemoveContainer" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" Sep 11 08:49:10.055912 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055872 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164"} err="failed to get container status \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": rpc error: code = NotFound desc = could not find container \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": container with ID starting with 25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164 not found: ID does not exist" Sep 11 08:49:10.055994 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.055914 2584 scope.go:117] "RemoveContainer" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" Sep 11 08:49:10.056214 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.056190 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25"} err="failed to get container status \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": rpc error: code = NotFound desc = could not find container \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": container with ID starting with 1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25 not found: ID does not exist" Sep 11 08:49:10.056270 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.056218 2584 scope.go:117] "RemoveContainer" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" Sep 11 08:49:10.056514 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.056494 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9"} err="failed to get container status \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": rpc error: code = NotFound desc = could not find container \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": container with ID starting with 149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9 not found: ID does not exist" Sep 11 08:49:10.056569 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.056515 2584 scope.go:117] "RemoveContainer" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" Sep 11 08:49:10.056790 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.056765 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e"} err="failed to get container status \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": rpc error: code = NotFound desc = could not find container \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": container with ID starting with 109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e not found: ID does not exist" Sep 11 08:49:10.056944 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.056793 2584 scope.go:117] "RemoveContainer" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" Sep 11 08:49:10.057054 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057037 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9"} err="failed to get container status \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": rpc error: code = NotFound desc = could not find container \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": container with ID starting with a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9 not found: ID does not exist" Sep 11 08:49:10.057106 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057055 2584 scope.go:117] "RemoveContainer" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" Sep 11 08:49:10.057428 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057406 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a"} err="failed to get container status \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": rpc error: code = NotFound desc = could not find container \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": container with ID starting with 0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a not found: ID does not exist" Sep 11 08:49:10.057495 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057427 2584 scope.go:117] "RemoveContainer" containerID="c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d" Sep 11 08:49:10.057563 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057545 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 11 08:49:10.057701 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057573 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 11 08:49:10.057701 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057582 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b4mqt\"" Sep 11 08:49:10.057701 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057674 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 11 08:49:10.057973 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057953 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 11 08:49:10.058045 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057983 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 11 08:49:10.058134 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.057953 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d"} err="failed to get container status \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": rpc error: code = NotFound desc = could not find container \"c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d\": container with ID starting with c51ffe028c6c9e07e4173c417394b52eccff4e4edd5c8dec229c087e700e4d5d not found: ID does not exist" Sep 11 08:49:10.058260 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058239 2584 scope.go:117] "RemoveContainer" containerID="25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164" Sep 11 08:49:10.058348 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058313 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 11 08:49:10.058408 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058366 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 11 08:49:10.058408 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058386 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 11 08:49:10.058545 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058434 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 11 08:49:10.058740 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058721 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 11 08:49:10.058916 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058867 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164"} err="failed to get container status \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": rpc error: code = NotFound desc = could not find container \"25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164\": container with ID starting with 25d4612c39efb6047ec1ec2ca9dbaedc5c617b2a09b564ccdd867ede61af2164 not found: ID does not exist" Sep 11 08:49:10.058916 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058911 2584 scope.go:117] "RemoveContainer" containerID="1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25" Sep 11 08:49:10.059142 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058985 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 11 08:49:10.059142 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.058985 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 11 08:49:10.059142 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.059068 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3abp08785s1tb\"" Sep 11 08:49:10.059142 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.059118 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 11 08:49:10.059544 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.059508 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25"} err="failed to get container status \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": rpc error: code = NotFound desc = could not find container \"1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25\": container with ID starting with 1843c2d904ce2999fe105ce4a7df6efc9ba751a6fc31d4ee55bc75df7650ce25 not found: ID does not exist" Sep 11 08:49:10.059544 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.059532 2584 scope.go:117] "RemoveContainer" containerID="149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9" Sep 11 08:49:10.060047 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.059943 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9"} err="failed to get container status \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": rpc error: code = NotFound desc = could not find container \"149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9\": container with ID starting with 149f97b7b1bcdabfdad0b8d87d85dc5f0ed3d8999d6a73b9d14da9bf73b7b3e9 not found: ID does not exist" Sep 11 08:49:10.060047 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.059977 2584 scope.go:117] "RemoveContainer" containerID="109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e" Sep 11 08:49:10.060582 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.060513 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e"} err="failed to get container status \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": rpc error: code = NotFound desc = could not find container \"109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e\": container with ID starting with 109b378608a7d8c8dfb0e2ebdb6ece83b7f427b6bdb097416d89287664ae971e not found: ID does not exist" Sep 11 08:49:10.060582 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.060542 2584 scope.go:117] "RemoveContainer" containerID="a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9" Sep 11 08:49:10.061032 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.060872 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9"} err="failed to get container status \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": rpc error: code = NotFound desc = could not find container \"a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9\": container with ID starting with a555df74f70313790f03f07e2eec56f027365c957861157f04aaf363c344e2c9 not found: ID does not exist" Sep 11 08:49:10.061032 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.060924 2584 scope.go:117] "RemoveContainer" containerID="0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a" Sep 11 08:49:10.061198 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.061178 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 11 08:49:10.061260 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.061220 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a"} err="failed to get container status \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": rpc error: code = NotFound desc = could not find container \"0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a\": container with ID starting with 0ae421d08e6ec412bde7768141568cf7e73d61027855ac872098dddaada2ac2a not found: ID does not exist" Sep 11 08:49:10.066039 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.066017 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 11 08:49:10.072861 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.072836 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:49:10.123604 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123604 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123575 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123604 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123598 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6qzn\" (UniqueName: \"kubernetes.io/projected/177e073f-c35f-4f6a-9d93-58e33b696961-kube-api-access-k6qzn\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123787 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123675 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-web-config\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123787 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123708 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123787 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123726 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123787 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123751 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123787 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123778 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/177e073f-c35f-4f6a-9d93-58e33b696961-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123959 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123801 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123959 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123816 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123959 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123831 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/177e073f-c35f-4f6a-9d93-58e33b696961-config-out\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123959 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123908 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-config\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123959 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123937 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.123959 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.123955 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.124130 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.124002 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.124130 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.124026 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.124130 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.124048 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.124130 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.124078 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.124130 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.124094 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.124130 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.124113 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.140632 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.140610 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3cad9f-e064-4eaf-b6f6-4518ed609f27" path="/var/lib/kubelet/pods/1e3cad9f-e064-4eaf-b6f6-4518ed609f27/volumes" Sep 11 08:49:10.224799 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224756 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.224799 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224827 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224846 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/177e073f-c35f-4f6a-9d93-58e33b696961-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224867 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224910 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224931 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/177e073f-c35f-4f6a-9d93-58e33b696961-config-out\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224959 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-config\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.224980 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225033 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225071 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225060 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225082 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225114 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225141 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225174 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225206 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225243 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225265 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6qzn\" (UniqueName: \"kubernetes.io/projected/177e073f-c35f-4f6a-9d93-58e33b696961-kube-api-access-k6qzn\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225315 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-web-config\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225509 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225460 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225983 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225732 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225983 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225786 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225983 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225906 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.225983 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.225958 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.227124 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.227080 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.227507 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.227478 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.228367 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.228231 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-web-config\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.229041 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.228596 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.229041 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.229004 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-config\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.229407 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.229370 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.229644 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.229623 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/177e073f-c35f-4f6a-9d93-58e33b696961-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.230079 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.230048 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.230162 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.230147 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.230217 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.230171 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/177e073f-c35f-4f6a-9d93-58e33b696961-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.230483 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.230458 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.230558 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.230540 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.231235 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.231218 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/177e073f-c35f-4f6a-9d93-58e33b696961-config-out\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.231658 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.231637 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/177e073f-c35f-4f6a-9d93-58e33b696961-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.233602 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.233578 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6qzn\" (UniqueName: \"kubernetes.io/projected/177e073f-c35f-4f6a-9d93-58e33b696961-kube-api-access-k6qzn\") pod \"prometheus-k8s-0\" (UID: \"177e073f-c35f-4f6a-9d93-58e33b696961\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.373060 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.373022 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:49:10.657371 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:10.657346 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 11 08:49:10.659240 ip-10-0-138-35 kubenswrapper[2584]: W0911 08:49:10.659213 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177e073f_c35f_4f6a_9d93_58e33b696961.slice/crio-a90bfd681d08cedb16026d93b217c9cde2842e5887d5912cea0eacc7daa8330d WatchSource:0}: Error finding container a90bfd681d08cedb16026d93b217c9cde2842e5887d5912cea0eacc7daa8330d: Status 404 returned error can't find the container with id a90bfd681d08cedb16026d93b217c9cde2842e5887d5912cea0eacc7daa8330d Sep 11 08:49:11.001791 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:11.001707 2584 generic.go:356] "Generic (PLEG): container finished" podID="177e073f-c35f-4f6a-9d93-58e33b696961" containerID="2fa06664902148ccf27a57afac2f5bdb5452a9ae83e8c151479120cd71536a9b" exitCode=0 Sep 11 08:49:11.001791 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:11.001757 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"177e073f-c35f-4f6a-9d93-58e33b696961","Type":"ContainerDied","Data":"2fa06664902148ccf27a57afac2f5bdb5452a9ae83e8c151479120cd71536a9b"} Sep 11 08:49:11.002235 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:11.001819 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"177e073f-c35f-4f6a-9d93-58e33b696961","Type":"ContainerStarted","Data":"a90bfd681d08cedb16026d93b217c9cde2842e5887d5912cea0eacc7daa8330d"} Sep 11 08:49:12.009141 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:12.009101 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"177e073f-c35f-4f6a-9d93-58e33b696961","Type":"ContainerStarted","Data":"45ea71e4e656f4d3c23564de4313e1447344d209c4fce8c27155aeaecd3e97fe"} Sep 11 08:49:12.009522 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:12.009207 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"177e073f-c35f-4f6a-9d93-58e33b696961","Type":"ContainerStarted","Data":"5a06c30ec2bebac574cd8c4b106cf51cf0beefc8aa0ce776dbbd6eea89a21955"} Sep 11 08:49:12.009522 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:12.009239 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"177e073f-c35f-4f6a-9d93-58e33b696961","Type":"ContainerStarted","Data":"606b1341157e458b699b0cfafc5d03915074cc4d78c2e436261ff9e18758a82a"} Sep 11 08:49:12.009522 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:12.009265 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"177e073f-c35f-4f6a-9d93-58e33b696961","Type":"ContainerStarted","Data":"eea059d200c0ee443cad099daaa2f0a201ad6aea17d82e2a7f9267cb9ded0663"} Sep 11 08:49:12.009522 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:12.009299 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"177e073f-c35f-4f6a-9d93-58e33b696961","Type":"ContainerStarted","Data":"76d9df167e1184951745f2e3a60d77ccdde0e644cac4b7a495dbb312d54ebafd"} Sep 11 08:49:12.009522 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:12.009321 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"177e073f-c35f-4f6a-9d93-58e33b696961","Type":"ContainerStarted","Data":"838ac19b48966b91b41fa4655ec5bd36253a76fc59b86da0ded14214588e6afe"} Sep 11 08:49:12.036760 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:12.036699 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.018250784 podStartE2EDuration="2.036679946s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.429162ms" isStatefulPod=false podCreationTimestamp="2026-09-11 08:49:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 08:49:12.034809538 +0000 UTC m=+156.362186477" watchObservedRunningTime="2026-09-11 08:49:12.036679946 +0000 UTC m=+156.364056901" Sep 11 08:49:15.374033 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:49:15.373989 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:50:10.373638 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:50:10.373600 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:50:10.389097 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:50:10.389072 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:50:11.257823 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:50:11.257796 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 11 08:51:36.060476 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:51:36.060449 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 08:51:36.061503 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:51:36.061481 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 08:51:36.063820 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:51:36.063801 2584 kubelet.go:1648] "Image garbage collection succeeded" Sep 11 08:56:36.090100 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:56:36.090072 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 08:56:36.090736 ip-10-0-138-35 kubenswrapper[2584]: I0911 08:56:36.090718 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:01:36.117232 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:01:36.117156 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:01:36.117748 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:01:36.117723 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:06:36.146942 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:06:36.146912 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:06:36.149639 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:06:36.149616 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:11:36.180295 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:11:36.180269 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:11:36.182990 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:11:36.182961 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:16:36.207183 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:16:36.207155 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:16:36.210544 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:16:36.210524 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:17:53.637964 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:53.637934 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c2fvf_5bd3198a-fe39-49bd-bce0-fc4930f5a1b5/global-pull-secret-syncer/0.log" Sep 11 09:17:53.799534 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:53.799500 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c7b6l_cc293d75-ebd7-422b-9685-2a75bd515b52/konnectivity-agent/0.log" Sep 11 09:17:53.872792 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:53.872768 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-35.ec2.internal_93df758dcc4ccadda4b591db6160bde6/haproxy/0.log" Sep 11 09:17:57.545045 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.545017 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e8894bf-0f6b-4cd2-9af3-c98b52a62aad/alertmanager/0.log" Sep 11 09:17:57.579095 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.579059 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e8894bf-0f6b-4cd2-9af3-c98b52a62aad/config-reloader/0.log" Sep 11 09:17:57.610303 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.610282 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e8894bf-0f6b-4cd2-9af3-c98b52a62aad/kube-rbac-proxy-web/0.log" Sep 11 09:17:57.642038 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.642012 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e8894bf-0f6b-4cd2-9af3-c98b52a62aad/kube-rbac-proxy/0.log" Sep 11 09:17:57.675738 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.675715 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e8894bf-0f6b-4cd2-9af3-c98b52a62aad/kube-rbac-proxy-metric/0.log" Sep 11 09:17:57.702294 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.702269 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e8894bf-0f6b-4cd2-9af3-c98b52a62aad/prom-label-proxy/0.log" Sep 11 09:17:57.730776 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.730756 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e8894bf-0f6b-4cd2-9af3-c98b52a62aad/init-config-reloader/0.log" Sep 11 09:17:57.803901 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.803829 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-v5nvg_f491593e-deef-457f-af7a-0b34c9524de6/kube-state-metrics/0.log" Sep 11 09:17:57.832086 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.832063 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-v5nvg_f491593e-deef-457f-af7a-0b34c9524de6/kube-rbac-proxy-main/0.log" Sep 11 09:17:57.859305 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.859290 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-v5nvg_f491593e-deef-457f-af7a-0b34c9524de6/kube-rbac-proxy-self/0.log" Sep 11 09:17:57.923606 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.923583 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-jcnvn_5764916a-3155-491d-8750-b95da5e6fb1e/monitoring-plugin/0.log" Sep 11 09:17:57.959216 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.959189 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jt9ml_b46d1793-ddc0-4808-be95-c56171c83199/node-exporter/0.log" Sep 11 09:17:57.989758 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:57.989737 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jt9ml_b46d1793-ddc0-4808-be95-c56171c83199/kube-rbac-proxy/0.log" Sep 11 09:17:58.014844 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.014826 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jt9ml_b46d1793-ddc0-4808-be95-c56171c83199/init-textfile/0.log" Sep 11 09:17:58.323998 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.323972 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_177e073f-c35f-4f6a-9d93-58e33b696961/prometheus/0.log" Sep 11 09:17:58.351534 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.351511 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_177e073f-c35f-4f6a-9d93-58e33b696961/config-reloader/0.log" Sep 11 09:17:58.378600 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.378581 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_177e073f-c35f-4f6a-9d93-58e33b696961/thanos-sidecar/0.log" Sep 11 09:17:58.400753 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.400734 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_177e073f-c35f-4f6a-9d93-58e33b696961/kube-rbac-proxy-web/0.log" Sep 11 09:17:58.433225 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.433206 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_177e073f-c35f-4f6a-9d93-58e33b696961/kube-rbac-proxy/0.log" Sep 11 09:17:58.461474 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.461448 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_177e073f-c35f-4f6a-9d93-58e33b696961/kube-rbac-proxy-thanos/0.log" Sep 11 09:17:58.486729 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.486699 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_177e073f-c35f-4f6a-9d93-58e33b696961/init-config-reloader/0.log" Sep 11 09:17:58.516421 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.516399 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-l4kqk_e1b543cb-8a65-4e86-9f4d-1e1057403bf1/prometheus-operator/0.log" Sep 11 09:17:58.561814 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.561792 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-l4kqk_e1b543cb-8a65-4e86-9f4d-1e1057403bf1/kube-rbac-proxy/0.log" Sep 11 09:17:58.600585 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.600532 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-jxbfn_95cf7046-4d66-4dad-adeb-968f4a5fb073/prometheus-operator-admission-webhook/0.log" Sep 11 09:17:58.719603 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.719549 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbd67d86-wvjn2_7902f41e-6ffa-4aa1-be4a-e573cdcd678f/thanos-query/0.log" Sep 11 09:17:58.750128 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.750107 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbd67d86-wvjn2_7902f41e-6ffa-4aa1-be4a-e573cdcd678f/kube-rbac-proxy-web/0.log" Sep 11 09:17:58.776561 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.776545 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbd67d86-wvjn2_7902f41e-6ffa-4aa1-be4a-e573cdcd678f/kube-rbac-proxy/0.log" Sep 11 09:17:58.803261 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.803238 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbd67d86-wvjn2_7902f41e-6ffa-4aa1-be4a-e573cdcd678f/prom-label-proxy/0.log" Sep 11 09:17:58.832514 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.832493 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbd67d86-wvjn2_7902f41e-6ffa-4aa1-be4a-e573cdcd678f/kube-rbac-proxy-rules/0.log" Sep 11 09:17:58.865098 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:17:58.865050 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66fbd67d86-wvjn2_7902f41e-6ffa-4aa1-be4a-e573cdcd678f/kube-rbac-proxy-metrics/0.log" Sep 11 09:18:00.183992 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.183963 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-m6jwp_287b64ea-6bed-41b3-9793-2c295a10fa8a/networking-console-plugin/0.log" Sep 11 09:18:00.909114 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.909079 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6"] Sep 11 09:18:00.912406 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.912384 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:00.914442 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.914424 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qk7h7\"/\"default-dockercfg-2zmbc\"" Sep 11 09:18:00.914535 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.914458 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qk7h7\"/\"kube-root-ca.crt\"" Sep 11 09:18:00.914535 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.914517 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qk7h7\"/\"openshift-service-ca.crt\"" Sep 11 09:18:00.924290 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.924268 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6"] Sep 11 09:18:00.994467 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.994437 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s2pj\" (UniqueName: \"kubernetes.io/projected/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-kube-api-access-8s2pj\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:00.994628 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.994491 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-proc\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:00.994628 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.994567 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-sys\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:00.994628 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.994599 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-lib-modules\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:00.994628 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:00.994622 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-podres\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095020 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.094985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-sys\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095182 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.095029 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-lib-modules\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095182 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.095062 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-podres\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095182 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.095093 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s2pj\" (UniqueName: \"kubernetes.io/projected/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-kube-api-access-8s2pj\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095182 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.095148 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-lib-modules\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095182 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.095094 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-sys\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095182 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.095151 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-proc\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095182 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.095155 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-podres\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.095442 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.095198 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-proc\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.111828 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.111798 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s2pj\" (UniqueName: \"kubernetes.io/projected/5139fba5-dcba-4c4e-a1b3-cafc13eff6b0-kube-api-access-8s2pj\") pod \"perf-node-gather-daemonset-qnqq6\" (UID: \"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0\") " pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.222435 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.222352 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.506366 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.506244 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6"] Sep 11 09:18:01.509337 ip-10-0-138-35 kubenswrapper[2584]: W0911 09:18:01.509307 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5139fba5_dcba_4c4e_a1b3_cafc13eff6b0.slice/crio-7dc4668a1946ba3bede07c0754c0cff3afc2106e5e440f2e725b11a9e7849d33 WatchSource:0}: Error finding container 7dc4668a1946ba3bede07c0754c0cff3afc2106e5e440f2e725b11a9e7849d33: Status 404 returned error can't find the container with id 7dc4668a1946ba3bede07c0754c0cff3afc2106e5e440f2e725b11a9e7849d33 Sep 11 09:18:01.796390 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.796305 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" event={"ID":"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0","Type":"ContainerStarted","Data":"06371f104e7e05d5ce05c0238c21a1c946a1586571b130819116195299119105"} Sep 11 09:18:01.796390 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.796358 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" event={"ID":"5139fba5-dcba-4c4e-a1b3-cafc13eff6b0","Type":"ContainerStarted","Data":"7dc4668a1946ba3bede07c0754c0cff3afc2106e5e440f2e725b11a9e7849d33"} Sep 11 09:18:01.796390 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.796385 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:01.820546 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:01.820493 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" podStartSLOduration=1.8204746520000001 podStartE2EDuration="1.820474652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 09:18:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 09:18:01.819709151 +0000 UTC m=+1886.147086093" watchObservedRunningTime="2026-09-11 09:18:01.820474652 +0000 UTC m=+1886.147851593" Sep 11 09:18:02.837417 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:02.837391 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bpqk_e247b1d1-3872-4a7f-bfc3-7f7750830dd2/dns/0.log" Sep 11 09:18:02.909382 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:02.909349 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bpqk_e247b1d1-3872-4a7f-bfc3-7f7750830dd2/kube-rbac-proxy/0.log" Sep 11 09:18:03.244268 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:03.244240 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rwdtp_759ae063-04b2-4e1c-a2af-a608761aca21/dns-node-resolver/0.log" Sep 11 09:18:03.746806 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:03.746772 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7976d8b549-hcg2g_0bba807c-4ddd-4699-a0ae-e1e38d6500bd/registry/0.log" Sep 11 09:18:03.829927 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:03.829901 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-srk4w_f8f5a742-7b52-4fb4-a027-0c19181fb247/node-ca/0.log" Sep 11 09:18:05.089695 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:05.089663 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-78sm2_959dec7d-698c-439a-9658-56ec6292f667/serve-healthcheck-canary/0.log" Sep 11 09:18:05.497999 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:05.497976 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88vjx_c793c346-5d35-4755-ad41-52b4ec6e7305/kube-rbac-proxy/0.log" Sep 11 09:18:05.524865 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:05.524845 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88vjx_c793c346-5d35-4755-ad41-52b4ec6e7305/exporter/0.log" Sep 11 09:18:05.547548 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:05.547526 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88vjx_c793c346-5d35-4755-ad41-52b4ec6e7305/extractor/0.log" Sep 11 09:18:07.810226 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:07.810200 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qk7h7/perf-node-gather-daemonset-qnqq6" Sep 11 09:18:10.290935 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:10.290850 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-s4lfd_222ef99a-7b1a-4855-a343-bd99c2edbc94/migrator/0.log" Sep 11 09:18:10.321725 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:10.321694 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-s4lfd_222ef99a-7b1a-4855-a343-bd99c2edbc94/graceful-termination/0.log" Sep 11 09:18:11.740026 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:11.740003 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7sgn_208c8836-9e40-4532-b9f1-02b4030fc364/kube-multus-additional-cni-plugins/0.log" Sep 11 09:18:11.770096 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:11.770074 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7sgn_208c8836-9e40-4532-b9f1-02b4030fc364/egress-router-binary-copy/0.log" Sep 11 09:18:11.795653 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:11.795627 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7sgn_208c8836-9e40-4532-b9f1-02b4030fc364/cni-plugins/0.log" Sep 11 09:18:11.829269 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:11.829246 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7sgn_208c8836-9e40-4532-b9f1-02b4030fc364/bond-cni-plugin/0.log" Sep 11 09:18:11.858281 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:11.858258 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7sgn_208c8836-9e40-4532-b9f1-02b4030fc364/routeoverride-cni/0.log" Sep 11 09:18:11.885616 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:11.885595 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7sgn_208c8836-9e40-4532-b9f1-02b4030fc364/whereabouts-cni-bincopy/0.log" Sep 11 09:18:11.910579 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:11.910559 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-b7sgn_208c8836-9e40-4532-b9f1-02b4030fc364/whereabouts-cni/0.log" Sep 11 09:18:12.366940 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:12.366862 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z47cc_3f0ec46f-ab10-4683-9f40-5f7c1250f02e/kube-multus/0.log" Sep 11 09:18:12.545936 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:12.545901 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9xp5k_88ce320d-1c5f-4f87-9cbd-0cee5cb7c076/network-metrics-daemon/0.log" Sep 11 09:18:12.579672 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:12.579644 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9xp5k_88ce320d-1c5f-4f87-9cbd-0cee5cb7c076/kube-rbac-proxy/0.log" Sep 11 09:18:13.533543 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.533516 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-controller/0.log" Sep 11 09:18:13.562846 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.562820 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/0.log" Sep 11 09:18:13.563003 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.562859 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovn-acl-logging/1.log" Sep 11 09:18:13.582958 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.582931 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/kube-rbac-proxy-node/0.log" Sep 11 09:18:13.609543 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.609518 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 09:18:13.642534 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.642504 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/northd/0.log" Sep 11 09:18:13.671102 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.671077 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/nbdb/0.log" Sep 11 09:18:13.697017 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.696990 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/sbdb/0.log" Sep 11 09:18:13.736021 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:13.735992 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxt2j_13e9b35e-dd8f-460e-b5a7-a2689386c582/ovnkube-controller/0.log" Sep 11 09:18:15.391470 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:15.391444 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kgbhf_c67f45da-f058-4d7c-91ad-486492813cb1/network-check-target-container/0.log" Sep 11 09:18:16.358008 ip-10-0-138-35 kubenswrapper[2584]: I0911 09:18:16.357978 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-h6pkf_6322f7ae-8caf-45a0-b3b0-4d64b07ce669/iptables-alerter/0.log"