Sep 07 12:08:17.317655 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 07 12:08:17.317797 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 07 12:08:17.317814 ip-10-0-133-190 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 07 12:08:17.318220 ip-10-0-133-190 systemd[1]: Failed to start Kubernetes Kubelet. Sep 07 12:08:26.873672 ip-10-0-133-190 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Sep 07 12:08:26.873687 ip-10-0-133-190 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3937f0c15d4345408b75e5fcc870757d -- Sep 07 12:09:57.820030 ip-10-0-133-190 systemd[1]: Starting Kubernetes Kubelet... Sep 07 12:09:58.250756 ip-10-0-133-190 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:09:58.251305 ip-10-0-133-190 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 12:09:58.251305 ip-10-0-133-190 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:09:58.251305 ip-10-0-133-190 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 12:09:58.251305 ip-10-0-133-190 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 12:09:58.253540 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.253460 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 12:09:58.261102 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261084 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:09:58.261102 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261099 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:09:58.261102 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261102 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261105 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261108 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261111 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261119 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261121 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261124 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261127 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261130 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261133 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261136 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261138 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261141 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261144 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261146 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261149 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261152 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261154 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261157 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261159 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:09:58.261192 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261162 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261164 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261167 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261169 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261172 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261174 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261177 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261180 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261183 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261185 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261188 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261191 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261193 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261196 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261199 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261202 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261205 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261207 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261210 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:09:58.261655 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261212 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261216 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261220 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261223 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261226 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261229 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261231 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261233 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261236 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261238 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261241 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261243 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261245 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261248 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261251 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261254 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261257 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261259 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261262 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:09:58.262172 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261264 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261267 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261270 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261273 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261275 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261278 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261280 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261283 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261285 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261288 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261290 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261293 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261295 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261297 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261300 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261303 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261306 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261308 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261311 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:09:58.262631 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261313 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261318 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261322 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261326 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261330 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261333 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261336 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261338 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261341 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261344 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261347 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261349 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261352 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261354 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261357 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261359 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261362 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261365 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:09:58.263103 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261367 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:09:58.263527 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.261369 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:09:58.263850 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263838 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:09:58.263850 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263849 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263852 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263855 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263858 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263862 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263865 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263867 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263870 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263873 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263875 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263878 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263881 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263883 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263886 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263888 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263891 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263893 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263896 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263898 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263901 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:09:58.263907 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263904 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263906 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263909 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263911 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263914 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263916 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263919 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263922 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263925 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263927 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263930 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263932 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263935 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263939 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263943 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263946 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263948 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263951 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263954 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:09:58.264496 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263957 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263960 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263962 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263965 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263967 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263970 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263973 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263975 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263978 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263981 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263983 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263985 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263988 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263991 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263995 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.263998 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264001 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264004 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264008 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264010 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:09:58.264988 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264013 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264015 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264018 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264021 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264023 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264025 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264028 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264030 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264033 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264035 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264038 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264040 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264043 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264046 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264048 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264051 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264053 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264056 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264059 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264061 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:09:58.265514 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264063 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264066 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264069 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264071 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264074 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264076 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264079 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264082 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264085 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264087 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264090 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264093 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264097 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264099 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264102 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264105 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264108 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264111 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264113 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264454 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:09:58.266019 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264459 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264462 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264465 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264467 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264470 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264472 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264475 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264479 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264483 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264486 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264488 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264491 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264494 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264497 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264500 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264503 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264506 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264509 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264511 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:09:58.266501 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264514 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264519 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264521 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264524 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264527 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264529 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264532 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264535 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264538 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264540 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264543 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264545 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264548 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264550 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264553 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264555 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264558 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264560 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264563 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264565 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:09:58.266967 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264568 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264570 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264573 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264575 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264577 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264580 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264583 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264585 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264588 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264590 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264593 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264595 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264598 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264602 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264605 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264608 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264610 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264613 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264615 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264617 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:09:58.267445 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264620 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264623 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264625 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264627 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264630 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264632 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264635 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264638 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264640 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264642 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264645 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264647 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264650 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264652 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264655 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264657 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264660 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264662 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264665 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:09:58.267941 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264667 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264670 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264673 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264675 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264678 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264680 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264684 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264687 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264689 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264692 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264695 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264697 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264700 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264702 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264705 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264708 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264710 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264714 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264717 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:09:58.268414 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.264720 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264822 2577 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264859 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264867 2577 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264872 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264876 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264879 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264887 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264891 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264894 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264897 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264901 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264904 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264907 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264910 2577 flags.go:64] FLAG: --cgroup-root="" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264913 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264916 2577 flags.go:64] FLAG: --client-ca-file="" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264919 2577 flags.go:64] FLAG: --cloud-provider="external" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264922 2577 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264928 2577 flags.go:64] FLAG: --cluster-domain="" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264930 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264933 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264936 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264940 2577 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 12:09:58.268884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264944 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264947 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264950 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264953 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264955 2577 flags.go:64] FLAG: --contention-profiling="false" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264959 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264962 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264965 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264968 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264972 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264975 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264977 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264980 2577 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264983 2577 flags.go:64] FLAG: --enable-server="true" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264985 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264989 2577 flags.go:64] FLAG: --event-burst="100" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264992 2577 flags.go:64] FLAG: --event-qps="50" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264995 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.264998 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265001 2577 flags.go:64] FLAG: --eviction-hard="" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265005 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265009 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265012 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265015 2577 flags.go:64] FLAG: --eviction-soft="" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265017 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 12:09:58.269448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265020 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265023 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265027 2577 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265029 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265032 2577 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265035 2577 flags.go:64] FLAG: --feature-gates="" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265039 2577 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265042 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265044 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265047 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265050 2577 flags.go:64] FLAG: --healthz-port="10248" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265053 2577 flags.go:64] FLAG: --help="false" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265056 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265061 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265063 2577 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265066 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265069 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265073 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265076 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265078 2577 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265081 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265084 2577 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265087 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265090 2577 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 12:09:58.270068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265093 2577 flags.go:64] FLAG: --kube-reserved="" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265095 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265098 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265101 2577 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265105 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265108 2577 flags.go:64] FLAG: --lock-file="" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265110 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265113 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265116 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265121 2577 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265125 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265127 2577 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265130 2577 flags.go:64] FLAG: --logging-format="text" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265133 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265136 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265139 2577 flags.go:64] FLAG: --manifest-url="" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265142 2577 flags.go:64] FLAG: --manifest-url-header="" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265146 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265149 2577 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265153 2577 flags.go:64] FLAG: --max-pods="110" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265156 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265158 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265161 2577 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265164 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265167 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 12:09:58.270657 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265170 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265173 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265179 2577 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265182 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265185 2577 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265188 2577 flags.go:64] FLAG: --pod-cidr="" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265191 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265196 2577 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265198 2577 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265201 2577 flags.go:64] FLAG: --pods-per-core="0" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265204 2577 flags.go:64] FLAG: --port="10250" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265207 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265211 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bef0cc9aa40cc81a" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265214 2577 flags.go:64] FLAG: --qos-reserved="" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265217 2577 flags.go:64] FLAG: --read-only-port="10255" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265220 2577 flags.go:64] FLAG: --register-node="true" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265223 2577 flags.go:64] FLAG: --register-with-taints="" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265226 2577 flags.go:64] FLAG: --registry-burst="10" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265229 2577 flags.go:64] FLAG: --registry-qps="5" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265232 2577 flags.go:64] FLAG: --reserved-cpus="" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265235 2577 flags.go:64] FLAG: --reserved-memory="" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265238 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265242 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265244 2577 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265247 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 12:09:58.271314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265250 2577 flags.go:64] FLAG: --runonce="false" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265253 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265256 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265258 2577 flags.go:64] FLAG: --seccomp-default="false" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265261 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265264 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265267 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265270 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265273 2577 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265276 2577 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265279 2577 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265282 2577 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265284 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265287 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265290 2577 flags.go:64] FLAG: --system-cgroups="" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265293 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265298 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265301 2577 flags.go:64] FLAG: --tls-cert-file="" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265303 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265308 2577 flags.go:64] FLAG: --tls-min-version="" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265311 2577 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265314 2577 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265316 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265319 2577 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265322 2577 flags.go:64] FLAG: --v="2" Sep 07 12:09:58.271949 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265326 2577 flags.go:64] FLAG: --version="false" Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265330 2577 flags.go:64] FLAG: --vmodule="" Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265333 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265336 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265442 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265445 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265450 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265454 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265456 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265459 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265462 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265464 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265467 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265470 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265472 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265475 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265477 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265480 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265482 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265484 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:09:58.272973 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265487 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265489 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265492 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265494 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265497 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265499 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265505 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265507 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265510 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265514 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265517 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265520 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265522 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265525 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265528 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265531 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265533 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265536 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265538 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:09:58.273835 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265541 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265544 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265546 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265549 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265551 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265554 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265556 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265559 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265562 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265564 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265567 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265570 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265572 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265574 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265577 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265579 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265582 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265584 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265586 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265590 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:09:58.274452 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265592 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265595 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265599 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265601 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265604 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265606 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265609 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265612 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265614 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265617 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265619 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265623 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265626 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265629 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265632 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265634 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265637 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265639 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265642 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265644 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:09:58.274990 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265647 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265650 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265652 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265656 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265659 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265662 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265665 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265668 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265670 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265673 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265675 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265679 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265681 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265684 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265688 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265690 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265693 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265695 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265698 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265700 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:09:58.275471 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265703 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265705 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265708 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.265710 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.265716 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.275444 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.275459 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.275478 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.275485 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275548 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275553 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275557 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275560 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275562 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275565 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:09:58.275971 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275568 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275570 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275573 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275576 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275578 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275581 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275584 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275586 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275589 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275591 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275593 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275596 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275599 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275602 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275604 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275606 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275609 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275612 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275615 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275617 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:09:58.276362 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275619 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275622 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275624 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275627 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275630 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275633 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275635 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275637 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275640 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275642 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275645 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275648 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275650 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275652 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275655 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275659 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275662 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275667 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275670 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:09:58.276859 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275674 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275678 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275680 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275683 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275686 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275689 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275692 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275694 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275697 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275700 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275702 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275704 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275707 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275710 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275712 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275715 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275718 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275720 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275723 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275725 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:09:58.277323 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275728 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275730 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275734 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275737 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275740 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275742 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275763 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275766 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275769 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275771 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275774 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275777 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275779 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275782 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275785 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275788 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275791 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275793 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275796 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:09:58.277819 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275798 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275801 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275803 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275806 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275808 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275811 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275813 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275815 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275818 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275821 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275823 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275826 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275828 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275831 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275833 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:09:58.278285 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.275838 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275953 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275958 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275961 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275964 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275967 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275970 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275973 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275976 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275979 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275982 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275984 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275987 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275991 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275993 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275996 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.275998 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276001 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276003 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276006 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 12:09:58.278673 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276008 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276011 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276013 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276016 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276018 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276020 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276023 2577 feature_gate.go:328] unrecognized feature gate: Example Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276025 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276029 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276033 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276036 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276038 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276041 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276043 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276046 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276049 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276051 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276055 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276058 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 12:09:58.279270 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276061 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276064 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276066 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276068 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276071 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276074 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276077 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276080 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276083 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276085 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276088 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276090 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276093 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276095 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276098 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276100 2577 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276103 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276105 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276108 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276110 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 12:09:58.279732 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276112 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276115 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276117 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276120 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276122 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276125 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276127 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276130 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276132 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276135 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276137 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276140 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276142 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276145 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276148 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276150 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276152 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276155 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276158 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 12:09:58.280262 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276160 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276163 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276166 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276168 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276171 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276174 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276176 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276179 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276181 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276184 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276186 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276188 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276191 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276194 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276196 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276199 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276201 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276205 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276208 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 12:09:58.280715 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276211 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 12:09:58.281182 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276214 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 12:09:58.281182 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:58.276217 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 12:09:58.281182 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.276222 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 12:09:58.281182 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.276328 2577 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 12:09:58.281182 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.278841 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 12:09:58.281182 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.279939 2577 server.go:1019] "Starting client certificate rotation" Sep 07 12:09:58.281182 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.280043 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 12:09:58.281182 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.280073 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 12:09:58.282732 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.282719 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 12:09:58.287650 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.287634 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 12:09:58.301038 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.301016 2577 log.go:25] "Validated CRI v1 runtime API" Sep 07 12:09:58.304281 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.304268 2577 log.go:25] "Validated CRI v1 image API" Sep 07 12:09:58.314158 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.314134 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 12:09:58.314566 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.314553 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 12:09:58.318008 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.317990 2577 fs.go:135] Filesystem UUIDs: map[516e8fe7-fe10-4230-a343-8914a22d3340:/dev/nvme0n1p3 738c1c11-3ee7-4afd-ad05-14285a530cc8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 07 12:09:58.318081 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.318008 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 12:09:58.323523 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.323422 2577 manager.go:216] Machine: {Timestamp:2026-09-07 12:09:58.322954804 +0000 UTC m=+0.372567103 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112064 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28bd95a8e84a21f08ee05c3fc8366d SystemUUID:ec28bd95-a8e8-4a21-f08e-e05c3fc8366d BootID:3937f0c1-5d43-4540-8b75-e5fcc870757d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:25:ee:24:6b:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:25:ee:24:6b:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:45:f3:08:cb:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 12:09:58.323523 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.323521 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 12:09:58.323617 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.323586 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 12:09:58.327479 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.327454 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 12:09:58.327605 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.327483 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-190.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 12:09:58.328344 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.328334 2577 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 12:09:58.328374 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.328347 2577 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 12:09:58.328374 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.328355 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 12:09:58.329375 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.329365 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 12:09:58.331282 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.331272 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 12:09:58.336491 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.336479 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 07 12:09:58.336599 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.336590 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 12:09:58.336627 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.336621 2577 kubelet.go:486] "Attempting to sync node with API server" Sep 07 12:09:58.336653 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.336631 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 12:09:58.336653 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.336642 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 12:09:58.336653 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.336650 2577 kubelet.go:398] "Adding apiserver pod source" Sep 07 12:09:58.336738 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.336658 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 12:09:58.337051 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.337038 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 12:09:58.337096 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.337065 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 12:09:58.339409 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.339388 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 12:09:58.342423 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.342407 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 12:09:58.342496 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.342438 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 12:09:58.342598 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.342585 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 12:09:58.342598 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.342600 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 12:09:58.342699 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.342607 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 12:09:58.342699 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.342612 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 12:09:58.342699 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.342621 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 12:09:58.342699 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.342630 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 12:09:58.343297 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.343287 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 12:09:58.343297 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.343297 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 12:09:58.343359 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.343304 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 12:09:58.343359 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.343310 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 12:09:58.343359 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.343318 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 12:09:58.343359 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.343326 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 12:09:58.345038 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.345024 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 12:09:58.345107 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.345056 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 12:09:58.347325 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.347299 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 12:09:58.347380 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.347345 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 12:09:58.347418 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.347367 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-190.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 12:09:58.348873 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.348858 2577 server.go:1268] "Started kubelet" Sep 07 12:09:58.349007 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.348939 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 12:09:58.349007 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.348967 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 12:09:58.349148 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.349047 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 12:09:58.349871 ip-10-0-133-190 systemd[1]: Started Kubernetes Kubelet. Sep 07 12:09:58.350658 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.350616 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 12:09:58.350961 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.350890 2577 server.go:310] "Adding debug handlers to kubelet server" Sep 07 12:09:58.356884 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.356863 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 12:09:58.358267 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.358250 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tnchg" Sep 07 12:09:58.361708 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.361575 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 12:09:58.362215 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.362199 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 12:09:58.362318 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.362301 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:58.362985 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.362968 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 12:09:58.362985 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.362969 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 12:09:58.363109 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.363013 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 12:09:58.363181 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.363167 2577 reconstruct.go:97] "Volume reconstruction finished" Sep 07 12:09:58.363223 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.363183 2577 reconciler.go:29] "Reconciler: start to sync state" Sep 07 12:09:58.363979 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.363845 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tnchg" Sep 07 12:09:58.364284 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.364268 2577 factory.go:153] Registering CRI-O factory Sep 07 12:09:58.364345 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.364288 2577 factory.go:223] Registration of the crio container factory successfully Sep 07 12:09:58.364345 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.364335 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 12:09:58.364345 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.364343 2577 factory.go:55] Registering systemd factory Sep 07 12:09:58.364425 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.364352 2577 factory.go:223] Registration of the systemd container factory successfully Sep 07 12:09:58.364425 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.364371 2577 factory.go:103] Registering Raw factory Sep 07 12:09:58.364425 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.364386 2577 manager.go:1196] Started watching for new ooms in manager Sep 07 12:09:58.364742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.364730 2577 manager.go:349] Starting recovery of all containers Sep 07 12:09:58.366312 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.366284 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 12:09:58.366392 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.366341 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 12:09:58.367695 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.366492 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-190.ec2.internal.18d308a8dcd7101d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-190.ec2.internal,UID:ip-10-0-133-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-190.ec2.internal,},FirstTimestamp:2026-09-07 12:09:58.348828701 +0000 UTC m=+0.398440987,LastTimestamp:2026-09-07 12:09:58.348828701 +0000 UTC m=+0.398440987,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-190.ec2.internal,}" Sep 07 12:09:58.375354 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.375339 2577 manager.go:354] Recovery completed Sep 07 12:09:58.379088 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.379075 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:09:58.380725 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.380708 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:09:58.380833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.380736 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:09:58.380833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.380763 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:09:58.381326 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.381313 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 12:09:58.381326 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.381324 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 12:09:58.381409 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.381338 2577 state_mem.go:36] "Initialized new in-memory state store" Sep 07 12:09:58.381409 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.381392 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:09:58.382129 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.382116 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:09:58.382169 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.382141 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:09:58.382169 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.382151 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:09:58.383452 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.383440 2577 policy_none.go:49] "None policy: Start" Sep 07 12:09:58.383500 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.383455 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 12:09:58.383500 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.383465 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 12:09:58.385443 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.385432 2577 policy_none.go:47] "Start" Sep 07 12:09:58.434310 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.434293 2577 manager.go:337] "Starting Device Plugin manager" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.434328 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.434338 2577 server.go:87] "Starting device plugin registration server" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.434868 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.434918 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.435337 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.435424 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.435432 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.436117 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.436171 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.440685 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.442009 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.442048 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.442065 2577 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.442098 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 12:09:58.447450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.443697 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:09:58.535288 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.535158 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:09:58.536196 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.536177 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:09:58.536292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.536208 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:09:58.536292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.536220 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:09:58.536292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.536258 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.542634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.542615 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal"] Sep 07 12:09:58.542727 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.542679 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:09:58.543511 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.543494 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:09:58.543582 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.543526 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:09:58.543582 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.543540 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:09:58.545932 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.545918 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:09:58.546094 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546079 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.546164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546109 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:09:58.546375 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546360 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.546424 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.546388 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-190.ec2.internal\": node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:58.546621 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546608 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:09:58.546685 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546633 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:09:58.546685 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546647 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:09:58.546685 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546670 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:09:58.546846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546690 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:09:58.546846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.546699 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:09:58.548984 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.548970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.549072 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.548994 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 12:09:58.549673 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.549654 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientMemory" Sep 07 12:09:58.549773 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.549686 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 12:09:58.549773 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.549697 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeHasSufficientPID" Sep 07 12:09:58.564157 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.564132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/51528ea83eda14d192d50d6c1bad1e46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"51528ea83eda14d192d50d6c1bad1e46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.564249 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.564158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51528ea83eda14d192d50d6c1bad1e46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"51528ea83eda14d192d50d6c1bad1e46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.564249 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.564176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f328a84a0fd2509d73f64d83dcb2186-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"9f328a84a0fd2509d73f64d83dcb2186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.571461 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.571432 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:58.575327 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.575309 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-190.ec2.internal\" not found" node="ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.579734 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.579719 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-190.ec2.internal\" not found" node="ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.664477 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.664453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51528ea83eda14d192d50d6c1bad1e46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"51528ea83eda14d192d50d6c1bad1e46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.664576 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.664479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f328a84a0fd2509d73f64d83dcb2186-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"9f328a84a0fd2509d73f64d83dcb2186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.664576 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.664554 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51528ea83eda14d192d50d6c1bad1e46-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"51528ea83eda14d192d50d6c1bad1e46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.664576 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.664571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/51528ea83eda14d192d50d6c1bad1e46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"51528ea83eda14d192d50d6c1bad1e46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.664687 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.664536 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f328a84a0fd2509d73f64d83dcb2186-config\") pod \"kube-apiserver-proxy-ip-10-0-133-190.ec2.internal\" (UID: \"9f328a84a0fd2509d73f64d83dcb2186\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.664687 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.664605 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/51528ea83eda14d192d50d6c1bad1e46-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal\" (UID: \"51528ea83eda14d192d50d6c1bad1e46\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.671516 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.671498 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:58.771989 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.771958 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:58.872699 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.872633 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:58.878825 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.878804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.884322 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:58.884176 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" Sep 07 12:09:58.973039 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:58.973007 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:59.073515 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:59.073485 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:59.174050 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:59.173995 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:59.274592 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:59.274567 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:59.279734 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.279719 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 12:09:59.279868 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.279852 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 12:09:59.367240 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.367210 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 12:04:59 +0000 UTC" deadline="2028-03-27 01:12:09.486669636 +0000 UTC" Sep 07 12:09:59.367240 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.367234 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13597h2m10.119438664s" Sep 07 12:09:59.374954 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:59.374931 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:59.475441 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:09:59.475380 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-190.ec2.internal\" not found" Sep 07 12:09:59.504586 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.504565 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:09:59.563419 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.563393 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" Sep 07 12:09:59.576432 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.576415 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 12:09:59.578378 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.578364 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" Sep 07 12:09:59.586385 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.586371 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 12:09:59.624963 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.624945 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:09:59.629688 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.629671 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:09:59.802718 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:09:59.802678 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f328a84a0fd2509d73f64d83dcb2186.slice/crio-49eabd927b073f02253126fdedfa200b7a9fcfef5b77ca0613d540d89ecfc109 WatchSource:0}: Error finding container 49eabd927b073f02253126fdedfa200b7a9fcfef5b77ca0613d540d89ecfc109: Status 404 returned error can't find the container with id 49eabd927b073f02253126fdedfa200b7a9fcfef5b77ca0613d540d89ecfc109 Sep 07 12:09:59.807217 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:09:59.807203 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:10:01.462783 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:01.462762 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51528ea83eda14d192d50d6c1bad1e46.slice/crio-5083b8730b04a76618bbc05b4ac291871f0c87f50986c67087d8447554f9aca2 WatchSource:0}: Error finding container 5083b8730b04a76618bbc05b4ac291871f0c87f50986c67087d8447554f9aca2: Status 404 returned error can't find the container with id 5083b8730b04a76618bbc05b4ac291871f0c87f50986c67087d8447554f9aca2 Sep 07 12:10:01.863091 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.863067 2577 apiserver.go:52] "Watching apiserver" Sep 07 12:10:01.870010 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.869993 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 12:10:01.872148 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.872129 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pv9mz","kube-system/konnectivity-agent-cg7lx","kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg","openshift-image-registry/node-ca-bxjwz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal","openshift-multus/multus-v4r6m","openshift-network-diagnostics/network-check-target-gxclc","openshift-cluster-node-tuning-operator/tuned-545kx","openshift-dns/node-resolver-nd9tt","openshift-multus/multus-additional-cni-plugins-rkvs9","openshift-multus/network-metrics-daemon-7mjbg","openshift-network-operator/iptables-alerter-nvvg7","openshift-ovn-kubernetes/ovnkube-node-92kzn"] Sep 07 12:10:01.874774 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.874751 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.876700 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.876685 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:01.877816 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.877792 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 12:10:01.878243 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.877902 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 12:10:01.878243 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.878013 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qn9gs\"" Sep 07 12:10:01.878243 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.878080 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 12:10:01.878243 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.877794 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 12:10:01.879464 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.879305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:10:01.880095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.880068 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9lqth\"" Sep 07 12:10:01.880199 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.880177 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 12:10:01.880298 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.880198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 12:10:01.880777 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.880761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.882833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.882816 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 12:10:01.883003 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.882931 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 12:10:01.883003 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.882989 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d5ptc\"" Sep 07 12:10:01.883116 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.883087 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 12:10:01.883237 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.883222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:01.883858 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.883844 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 12:10:01.883926 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.883887 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 12:10:01.883926 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.883904 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 12:10:01.885042 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.885026 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 12:10:01.885208 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.885193 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 12:10:01.885278 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.885246 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 12:10:01.885331 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.885284 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:01.885620 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.885604 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p5njw\"" Sep 07 12:10:01.887337 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.887321 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 12:10:01.887538 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.887521 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 12:10:01.887538 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.887534 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2vmq2\"" Sep 07 12:10:01.887631 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.887547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 12:10:01.887631 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.887558 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:01.887700 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:01.887623 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:01.887700 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.887647 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 12:10:01.889737 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.889717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.891872 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.891853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:01.892006 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:01.891983 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:01.892101 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.892084 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:10:01.892175 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.892162 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9l4dm\"" Sep 07 12:10:01.892465 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.892453 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 12:10:01.894183 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.894167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:01.896531 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.896512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:01.896640 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.896515 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5qrjg\"" Sep 07 12:10:01.896770 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.896748 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 12:10:01.897011 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.896996 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 12:10:01.897985 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.897964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-iptables-alerter-script\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:01.898065 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-kubernetes\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898065 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898028 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysctl-conf\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898065 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-cni-multus\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898065 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898061 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-hostroot\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwj2s\" (UniqueName: \"kubernetes.io/projected/c1529f38-3198-4669-88fc-bceae306e488-kube-api-access-jwj2s\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-cni-bin\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898141 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97f79\" (UniqueName: \"kubernetes.io/projected/3a252e78-2d91-4150-a5cf-ada5362e9ec2-kube-api-access-97f79\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898168 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-cnibin\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-socket-dir-parent\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-sys\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898214 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-netns\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysctl-d\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-var-lib-kubelet\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-host\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1529f38-3198-4669-88fc-bceae306e488-cni-binary-copy\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898348 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-kubelet\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-systemd-units\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898387 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twlqh\" (UniqueName: \"kubernetes.io/projected/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-kube-api-access-twlqh\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-run\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-kubelet\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-modprobe-d\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-etc-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898510 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-serviceca\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysconfig\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-env-overrides\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1529f38-3198-4669-88fc-bceae306e488-multus-daemon-config\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898641 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-slash\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-host-slash\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898733 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-sys-fs\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:01.898796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-ovn\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898813 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898820 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-conf-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-device-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898883 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgjcn\" (UniqueName: \"kubernetes.io/projected/f0e6aaeb-d135-47e8-9580-adbc6aebce18-kube-api-access-wgjcn\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-multus-certs\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.898976 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kd5gl\"" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-cni-netd\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0e6aaeb-d135-47e8-9580-adbc6aebce18-tmp\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899130 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovnkube-script-lib\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6cxs\" (UniqueName: \"kubernetes.io/projected/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-kube-api-access-p6cxs\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-system-cni-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-cni-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-k8s-cni-cncf-io\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-tuned\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-run-netns\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.899472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-cni-bin\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899402 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-log-socket\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovnkube-config\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899446 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-systemd\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-systemd\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-var-lib-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-socket-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-etc-kubernetes\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-node-log\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-registration-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899571 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-host\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpgqn\" (UniqueName: \"kubernetes.io/projected/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-kube-api-access-dpgqn\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:01.900082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.899606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-lib-modules\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:01.901239 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.901224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:01.901340 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:01.901323 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:01.901589 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.901571 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 12:10:01.901754 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.901738 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 12:10:01.901833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.901818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4r4dd\"" Sep 07 12:10:01.902197 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.902083 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 12:10:01.920004 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.919981 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-crf6b" Sep 07 12:10:01.928477 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.928460 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-crf6b" Sep 07 12:10:01.971748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.971702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" event={"ID":"9f328a84a0fd2509d73f64d83dcb2186","Type":"ContainerStarted","Data":"49eabd927b073f02253126fdedfa200b7a9fcfef5b77ca0613d540d89ecfc109"} Sep 07 12:10:01.972768 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.972743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"51528ea83eda14d192d50d6c1bad1e46","Type":"ContainerStarted","Data":"5083b8730b04a76618bbc05b4ac291871f0c87f50986c67087d8447554f9aca2"} Sep 07 12:10:01.983969 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.983936 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 12:10:01.989129 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:01.989116 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 12:10:02.000506 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.000570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-env-overrides\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.000570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.000570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1529f38-3198-4669-88fc-bceae306e488-multus-daemon-config\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.000570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-slash\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.000744 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-host-slash\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:02.000744 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000618 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.000744 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000644 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-slash\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.000744 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000659 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.000744 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000705 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000738 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000784 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzvlb\" (UniqueName: \"kubernetes.io/projected/524bf8ca-1381-4b45-9dd4-c4b00152a215-kube-api-access-zzvlb\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-sys-fs\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000813 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-host-slash\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-ovn\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000857 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-ovn\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-conf-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000893 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-sys-fs\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-device-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000928 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-conf-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgjcn\" (UniqueName: \"kubernetes.io/projected/f0e6aaeb-d135-47e8-9580-adbc6aebce18-kube-api-access-wgjcn\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.000974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000974 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-etc-selinux\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.000992 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-device-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001028 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-kubelet-config\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001123 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-multus-certs\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001149 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-multus-certs\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001152 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c1529f38-3198-4669-88fc-bceae306e488-multus-daemon-config\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001166 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-cni-netd\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0e6aaeb-d135-47e8-9580-adbc6aebce18-tmp\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001214 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-cni-netd\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovnkube-script-lib\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6cxs\" (UniqueName: \"kubernetes.io/projected/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-kube-api-access-p6cxs\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001285 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001312 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zht6x\" (UniqueName: \"kubernetes.io/projected/36018ab5-d35b-4664-8270-178d1220665c-kube-api-access-zht6x\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-system-cni-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-cni-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001459 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-system-cni-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.001545 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001477 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-k8s-cni-cncf-io\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001487 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-cni-dir\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001518 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-tuned\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-run-netns\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-cni-bin\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001575 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-k8s-cni-cncf-io\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001588 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-log-socket\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001608 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-run-netns\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001616 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-cni-bin\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovnkube-config\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-systemd\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zpnx\" (UniqueName: \"kubernetes.io/projected/e83a29fa-0986-450f-b369-6b4f79e109ff-kube-api-access-6zpnx\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001703 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-log-socket\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-systemd\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001747 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-systemd\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-var-lib-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-socket-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001752 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-env-overrides\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.002301 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001791 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-run-systemd\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/886d8775-2c32-4337-95fb-20ee0e597b87-konnectivity-ca\") pod \"konnectivity-agent-cg7lx\" (UID: \"886d8775-2c32-4337-95fb-20ee0e597b87\") " pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-etc-kubernetes\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001827 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-var-lib-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001892 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-etc-kubernetes\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001902 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-socket-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001925 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovnkube-script-lib\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001927 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-node-log\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.001981 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-node-log\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-registration-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-host\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpgqn\" (UniqueName: \"kubernetes.io/projected/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-kube-api-access-dpgqn\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-lib-modules\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002096 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-registration-dir\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002106 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-host\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-iptables-alerter-script\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:02.003120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-kubernetes\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysctl-conf\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-cni-multus\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002233 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovnkube-config\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-hostroot\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-lib-modules\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwj2s\" (UniqueName: \"kubernetes.io/projected/c1529f38-3198-4669-88fc-bceae306e488-kube-api-access-jwj2s\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-cni-bin\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002316 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-cni-multus\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97f79\" (UniqueName: \"kubernetes.io/projected/3a252e78-2d91-4150-a5cf-ada5362e9ec2-kube-api-access-97f79\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002337 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-kubernetes\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysctl-conf\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002355 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/886d8775-2c32-4337-95fb-20ee0e597b87-agent-certs\") pod \"konnectivity-agent-cg7lx\" (UID: \"886d8775-2c32-4337-95fb-20ee0e597b87\") " pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36018ab5-d35b-4664-8270-178d1220665c-tmp-dir\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002386 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-hostroot\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002388 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-cni-bin\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-cnibin\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-cnibin\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.003846 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002491 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-cnibin\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-socket-dir-parent\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002543 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-sys\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-dbus\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36018ab5-d35b-4664-8270-178d1220665c-hosts-file\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002609 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-multus-socket-dir-parent\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002619 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-netns\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002617 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-iptables-alerter-script\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002634 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-sys\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002653 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002677 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-run-netns\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysctl-d\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002750 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-var-lib-kubelet\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002811 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysctl-d\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-host\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002860 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-var-lib-kubelet\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.004445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002922 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-host\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.002964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1529f38-3198-4669-88fc-bceae306e488-cni-binary-copy\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-kubelet\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-systemd-units\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003070 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1529f38-3198-4669-88fc-bceae306e488-host-var-lib-kubelet\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twlqh\" (UniqueName: \"kubernetes.io/projected/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-kube-api-access-twlqh\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-run\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-kubelet\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003140 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-systemd-units\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-modprobe-d\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-system-cni-dir\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003240 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003257 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-modprobe-d\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003286 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003314 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-run\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003322 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-kubelet\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.004968 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-etc-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003471 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-etc-openvswitch\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-serviceca\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3a252e78-2d91-4150-a5cf-ada5362e9ec2-host-run-ovn-kubernetes\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysconfig\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003749 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-sysconfig\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.003848 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1529f38-3198-4669-88fc-bceae306e488-cni-binary-copy\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.004093 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-serviceca\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.005416 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0e6aaeb-d135-47e8-9580-adbc6aebce18-tmp\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.005635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.005479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0e6aaeb-d135-47e8-9580-adbc6aebce18-etc-tuned\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.005925 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.005663 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3a252e78-2d91-4150-a5cf-ada5362e9ec2-ovn-node-metrics-cert\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.008375 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.008349 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:10:02.008476 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.008382 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:10:02.008476 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.008397 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hxvfb for pod openshift-network-diagnostics/network-check-target-gxclc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:02.008476 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.008468 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb podName:41c98bc0-8d70-4f48-9b70-7fd4287e3ee8 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:02.508446358 +0000 UTC m=+3.032862655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hxvfb" (UniqueName: "kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb") pod "network-check-target-gxclc" (UID: "41c98bc0-8d70-4f48-9b70-7fd4287e3ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:02.009366 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.009335 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgjcn\" (UniqueName: \"kubernetes.io/projected/f0e6aaeb-d135-47e8-9580-adbc6aebce18-kube-api-access-wgjcn\") pod \"tuned-545kx\" (UID: \"f0e6aaeb-d135-47e8-9580-adbc6aebce18\") " pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.009496 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.009479 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6cxs\" (UniqueName: \"kubernetes.io/projected/4edcc1b8-b6f4-4b01-a525-6b939f477ca3-kube-api-access-p6cxs\") pod \"iptables-alerter-nvvg7\" (UID: \"4edcc1b8-b6f4-4b01-a525-6b939f477ca3\") " pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:02.010341 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.010316 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwj2s\" (UniqueName: \"kubernetes.io/projected/c1529f38-3198-4669-88fc-bceae306e488-kube-api-access-jwj2s\") pod \"multus-v4r6m\" (UID: \"c1529f38-3198-4669-88fc-bceae306e488\") " pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.010458 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.010441 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twlqh\" (UniqueName: \"kubernetes.io/projected/b253bb79-6c39-4bb2-9dbd-9826b18a83a4-kube-api-access-twlqh\") pod \"aws-ebs-csi-driver-node-5g2zg\" (UID: \"b253bb79-6c39-4bb2-9dbd-9826b18a83a4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.010540 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.010525 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpgqn\" (UniqueName: \"kubernetes.io/projected/5281b9b2-ab6e-4a02-877b-e9ebe79f8d83-kube-api-access-dpgqn\") pod \"node-ca-bxjwz\" (UID: \"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83\") " pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:02.010747 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.010729 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97f79\" (UniqueName: \"kubernetes.io/projected/3a252e78-2d91-4150-a5cf-ada5362e9ec2-kube-api-access-97f79\") pod \"ovnkube-node-92kzn\" (UID: \"3a252e78-2d91-4150-a5cf-ada5362e9ec2\") " pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.104450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104417 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/886d8775-2c32-4337-95fb-20ee0e597b87-agent-certs\") pod \"konnectivity-agent-cg7lx\" (UID: \"886d8775-2c32-4337-95fb-20ee0e597b87\") " pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:02.104450 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36018ab5-d35b-4664-8270-178d1220665c-tmp-dir\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-cnibin\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-dbus\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36018ab5-d35b-4664-8270-178d1220665c-hosts-file\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104557 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-cnibin\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104570 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104617 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-system-cni-dir\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.104665 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.104660 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104668 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-dbus\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-system-cni-dir\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104657 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36018ab5-d35b-4664-8270-178d1220665c-hosts-file\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.104735 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs podName:524bf8ca-1381-4b45-9dd4-c4b00152a215 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:02.604718001 +0000 UTC m=+3.129134291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs") pod "network-metrics-daemon-7mjbg" (UID: "524bf8ca-1381-4b45-9dd4-c4b00152a215") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzvlb\" (UniqueName: \"kubernetes.io/projected/524bf8ca-1381-4b45-9dd4-c4b00152a215-kube-api-access-zzvlb\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104787 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-kubelet-config\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zht6x\" (UniqueName: \"kubernetes.io/projected/36018ab5-d35b-4664-8270-178d1220665c-kube-api-access-zht6x\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104820 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36018ab5-d35b-4664-8270-178d1220665c-tmp-dir\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zpnx\" (UniqueName: \"kubernetes.io/projected/e83a29fa-0986-450f-b369-6b4f79e109ff-kube-api-access-6zpnx\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/886d8775-2c32-4337-95fb-20ee0e597b87-konnectivity-ca\") pod \"konnectivity-agent-cg7lx\" (UID: \"886d8775-2c32-4337-95fb-20ee0e597b87\") " pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104929 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-kubelet-config\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.104979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.105095 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.105072 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:02.105635 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.105110 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret podName:ddd00b50-9a74-4d9a-a5e8-ce1986cdc942 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:02.605098025 +0000 UTC m=+3.129514295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret") pod "global-pull-secret-syncer-pv9mz" (UID: "ddd00b50-9a74-4d9a-a5e8-ce1986cdc942") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:02.105635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.105259 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.105635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.105259 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.105635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.105382 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e83a29fa-0986-450f-b369-6b4f79e109ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.105635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.105475 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e83a29fa-0986-450f-b369-6b4f79e109ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.105635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.105542 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/886d8775-2c32-4337-95fb-20ee0e597b87-konnectivity-ca\") pod \"konnectivity-agent-cg7lx\" (UID: \"886d8775-2c32-4337-95fb-20ee0e597b87\") " pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:02.106797 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.106780 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/886d8775-2c32-4337-95fb-20ee0e597b87-agent-certs\") pod \"konnectivity-agent-cg7lx\" (UID: \"886d8775-2c32-4337-95fb-20ee0e597b87\") " pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:02.113159 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.113105 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zht6x\" (UniqueName: \"kubernetes.io/projected/36018ab5-d35b-4664-8270-178d1220665c-kube-api-access-zht6x\") pod \"node-resolver-nd9tt\" (UID: \"36018ab5-d35b-4664-8270-178d1220665c\") " pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.114167 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.114146 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zpnx\" (UniqueName: \"kubernetes.io/projected/e83a29fa-0986-450f-b369-6b4f79e109ff-kube-api-access-6zpnx\") pod \"multus-additional-cni-plugins-rkvs9\" (UID: \"e83a29fa-0986-450f-b369-6b4f79e109ff\") " pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.114250 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.114183 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzvlb\" (UniqueName: \"kubernetes.io/projected/524bf8ca-1381-4b45-9dd4-c4b00152a215-kube-api-access-zzvlb\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:02.185092 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.185064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v4r6m" Sep 07 12:10:02.192443 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.192423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvvg7" Sep 07 12:10:02.196171 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.196150 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1529f38_3198_4669_88fc_bceae306e488.slice/crio-00f30c1328d30a5413c135865bc56e30608a920016d4bd61151a99d1e8e1afc5 WatchSource:0}: Error finding container 00f30c1328d30a5413c135865bc56e30608a920016d4bd61151a99d1e8e1afc5: Status 404 returned error can't find the container with id 00f30c1328d30a5413c135865bc56e30608a920016d4bd61151a99d1e8e1afc5 Sep 07 12:10:02.200546 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.200527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:02.200768 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.200748 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edcc1b8_b6f4_4b01_a525_6b939f477ca3.slice/crio-f02ccaa6d1ef93b64a37fece1a5d246c08fc907bcf3da26d9da8b44b76ac2f3d WatchSource:0}: Error finding container f02ccaa6d1ef93b64a37fece1a5d246c08fc907bcf3da26d9da8b44b76ac2f3d: Status 404 returned error can't find the container with id f02ccaa6d1ef93b64a37fece1a5d246c08fc907bcf3da26d9da8b44b76ac2f3d Sep 07 12:10:02.205313 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.205298 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" Sep 07 12:10:02.209680 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.209659 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a252e78_2d91_4150_a5cf_ada5362e9ec2.slice/crio-a22944709fca3ccdbac85d5ff49f65f2a8c4624b7f8c4ca0ce6affdb9e76131f WatchSource:0}: Error finding container a22944709fca3ccdbac85d5ff49f65f2a8c4624b7f8c4ca0ce6affdb9e76131f: Status 404 returned error can't find the container with id a22944709fca3ccdbac85d5ff49f65f2a8c4624b7f8c4ca0ce6affdb9e76131f Sep 07 12:10:02.213148 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.213127 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" Sep 07 12:10:02.217000 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.216977 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb253bb79_6c39_4bb2_9dbd_9826b18a83a4.slice/crio-e0e1ed08c996f719186b4e88ab585075d93232087be638c1978a0f7c6177e708 WatchSource:0}: Error finding container e0e1ed08c996f719186b4e88ab585075d93232087be638c1978a0f7c6177e708: Status 404 returned error can't find the container with id e0e1ed08c996f719186b4e88ab585075d93232087be638c1978a0f7c6177e708 Sep 07 12:10:02.220017 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.219997 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxjwz" Sep 07 12:10:02.221571 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.221550 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83a29fa_0986_450f_b369_6b4f79e109ff.slice/crio-a83ad97097556e8a15bad43ae42b33d2e30cb619a14d830947d44d9466ee47ba WatchSource:0}: Error finding container a83ad97097556e8a15bad43ae42b33d2e30cb619a14d830947d44d9466ee47ba: Status 404 returned error can't find the container with id a83ad97097556e8a15bad43ae42b33d2e30cb619a14d830947d44d9466ee47ba Sep 07 12:10:02.223541 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.223520 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-545kx" Sep 07 12:10:02.229018 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.229002 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:02.230090 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.229974 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5281b9b2_ab6e_4a02_877b_e9ebe79f8d83.slice/crio-cd68ce39e1cafa9b687ff18abd89993db9bb4337de6eb92f33f308e8cc66b651 WatchSource:0}: Error finding container cd68ce39e1cafa9b687ff18abd89993db9bb4337de6eb92f33f308e8cc66b651: Status 404 returned error can't find the container with id cd68ce39e1cafa9b687ff18abd89993db9bb4337de6eb92f33f308e8cc66b651 Sep 07 12:10:02.231915 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.231894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nd9tt" Sep 07 12:10:02.232137 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.232045 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e6aaeb_d135_47e8_9580_adbc6aebce18.slice/crio-9899fe9f5c5e2a47b373caaef87e375473008dac589d1023b6eba109cd69cf6c WatchSource:0}: Error finding container 9899fe9f5c5e2a47b373caaef87e375473008dac589d1023b6eba109cd69cf6c: Status 404 returned error can't find the container with id 9899fe9f5c5e2a47b373caaef87e375473008dac589d1023b6eba109cd69cf6c Sep 07 12:10:02.238695 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.238675 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886d8775_2c32_4337_95fb_20ee0e597b87.slice/crio-b815febc2de86a49ad8968acd9c35a6d4a8f4e55f3d946d39cbfa93d510de374 WatchSource:0}: Error finding container b815febc2de86a49ad8968acd9c35a6d4a8f4e55f3d946d39cbfa93d510de374: Status 404 returned error can't find the container with id b815febc2de86a49ad8968acd9c35a6d4a8f4e55f3d946d39cbfa93d510de374 Sep 07 12:10:02.240520 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:02.240493 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36018ab5_d35b_4664_8270_178d1220665c.slice/crio-e8b66f8e48522aaaaa2d7e99698fe728e1f533e1c9af4392c9e09d14eb49936d WatchSource:0}: Error finding container e8b66f8e48522aaaaa2d7e99698fe728e1f533e1c9af4392c9e09d14eb49936d: Status 404 returned error can't find the container with id e8b66f8e48522aaaaa2d7e99698fe728e1f533e1c9af4392c9e09d14eb49936d Sep 07 12:10:02.607838 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.607756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:02.607838 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.607814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:02.608096 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.607844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:02.608096 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.608008 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:02.608175 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.608098 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs podName:524bf8ca-1381-4b45-9dd4-c4b00152a215 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:03.608077051 +0000 UTC m=+4.132493336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs") pod "network-metrics-daemon-7mjbg" (UID: "524bf8ca-1381-4b45-9dd4-c4b00152a215") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:02.608488 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.608465 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:02.608555 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.608546 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret podName:ddd00b50-9a74-4d9a-a5e8-ce1986cdc942 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:03.608502418 +0000 UTC m=+4.132918690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret") pod "global-pull-secret-syncer-pv9mz" (UID: "ddd00b50-9a74-4d9a-a5e8-ce1986cdc942") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:02.608640 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.608626 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:10:02.608680 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.608649 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:10:02.608680 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.608662 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hxvfb for pod openshift-network-diagnostics/network-check-target-gxclc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:02.608746 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:02.608697 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb podName:41c98bc0-8d70-4f48-9b70-7fd4287e3ee8 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:03.608686433 +0000 UTC m=+4.133102705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxvfb" (UniqueName: "kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb") pod "network-check-target-gxclc" (UID: "41c98bc0-8d70-4f48-9b70-7fd4287e3ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:02.932158 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.932067 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:05:01 +0000 UTC" deadline="2028-01-31 21:14:57.710656775 +0000 UTC" Sep 07 12:10:02.932158 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.932103 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12273h4m54.778557875s" Sep 07 12:10:02.976790 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.976751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" event={"ID":"e83a29fa-0986-450f-b369-6b4f79e109ff","Type":"ContainerStarted","Data":"a83ad97097556e8a15bad43ae42b33d2e30cb619a14d830947d44d9466ee47ba"} Sep 07 12:10:02.978253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.978230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" event={"ID":"b253bb79-6c39-4bb2-9dbd-9826b18a83a4","Type":"ContainerStarted","Data":"e0e1ed08c996f719186b4e88ab585075d93232087be638c1978a0f7c6177e708"} Sep 07 12:10:02.979752 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.979721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"a22944709fca3ccdbac85d5ff49f65f2a8c4624b7f8c4ca0ce6affdb9e76131f"} Sep 07 12:10:02.981092 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.981067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvvg7" event={"ID":"4edcc1b8-b6f4-4b01-a525-6b939f477ca3","Type":"ContainerStarted","Data":"f02ccaa6d1ef93b64a37fece1a5d246c08fc907bcf3da26d9da8b44b76ac2f3d"} Sep 07 12:10:02.982344 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.982313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cg7lx" event={"ID":"886d8775-2c32-4337-95fb-20ee0e597b87","Type":"ContainerStarted","Data":"b815febc2de86a49ad8968acd9c35a6d4a8f4e55f3d946d39cbfa93d510de374"} Sep 07 12:10:02.983554 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.983522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v4r6m" event={"ID":"c1529f38-3198-4669-88fc-bceae306e488","Type":"ContainerStarted","Data":"00f30c1328d30a5413c135865bc56e30608a920016d4bd61151a99d1e8e1afc5"} Sep 07 12:10:02.984659 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.984629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nd9tt" event={"ID":"36018ab5-d35b-4664-8270-178d1220665c","Type":"ContainerStarted","Data":"e8b66f8e48522aaaaa2d7e99698fe728e1f533e1c9af4392c9e09d14eb49936d"} Sep 07 12:10:02.985785 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.985760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-545kx" event={"ID":"f0e6aaeb-d135-47e8-9580-adbc6aebce18","Type":"ContainerStarted","Data":"9899fe9f5c5e2a47b373caaef87e375473008dac589d1023b6eba109cd69cf6c"} Sep 07 12:10:02.986931 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:02.986910 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxjwz" event={"ID":"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83","Type":"ContainerStarted","Data":"cd68ce39e1cafa9b687ff18abd89993db9bb4337de6eb92f33f308e8cc66b651"} Sep 07 12:10:03.615504 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:03.615438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:03.615504 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:03.615498 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:03.615716 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:03.615528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:03.615716 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.615644 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:03.615716 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.615709 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs podName:524bf8ca-1381-4b45-9dd4-c4b00152a215 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:05.615692045 +0000 UTC m=+6.140108326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs") pod "network-metrics-daemon-7mjbg" (UID: "524bf8ca-1381-4b45-9dd4-c4b00152a215") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:03.615873 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.615779 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:03.615873 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.615814 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret podName:ddd00b50-9a74-4d9a-a5e8-ce1986cdc942 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:05.615802517 +0000 UTC m=+6.140218791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret") pod "global-pull-secret-syncer-pv9mz" (UID: "ddd00b50-9a74-4d9a-a5e8-ce1986cdc942") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:03.616010 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.615895 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:10:03.616010 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.615909 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:10:03.616010 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.615922 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hxvfb for pod openshift-network-diagnostics/network-check-target-gxclc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:03.616010 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.615974 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb podName:41c98bc0-8d70-4f48-9b70-7fd4287e3ee8 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:05.615962085 +0000 UTC m=+6.140378355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxvfb" (UniqueName: "kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb") pod "network-check-target-gxclc" (UID: "41c98bc0-8d70-4f48-9b70-7fd4287e3ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:03.933153 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:03.933065 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:05:01 +0000 UTC" deadline="2028-04-21 10:33:43.76816056 +0000 UTC" Sep 07 12:10:03.933153 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:03.933103 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14206h23m39.835061576s" Sep 07 12:10:03.967575 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:03.967544 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:03.967575 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:03.967564 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:03.967780 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.967665 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:03.975247 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:03.975219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:03.975440 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.975414 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:03.975570 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:03.975553 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:05.634574 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:05.634534 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:05.634594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:05.634621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.634715 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.634738 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.634761 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs podName:524bf8ca-1381-4b45-9dd4-c4b00152a215 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:09.634748669 +0000 UTC m=+10.159164938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs") pod "network-metrics-daemon-7mjbg" (UID: "524bf8ca-1381-4b45-9dd4-c4b00152a215") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.634814 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret podName:ddd00b50-9a74-4d9a-a5e8-ce1986cdc942 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:09.634786136 +0000 UTC m=+10.159202420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret") pod "global-pull-secret-syncer-pv9mz" (UID: "ddd00b50-9a74-4d9a-a5e8-ce1986cdc942") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.634909 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.634926 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.634938 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hxvfb for pod openshift-network-diagnostics/network-check-target-gxclc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:05.635040 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.634993 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb podName:41c98bc0-8d70-4f48-9b70-7fd4287e3ee8 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:09.634981497 +0000 UTC m=+10.159397767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxvfb" (UniqueName: "kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb") pod "network-check-target-gxclc" (UID: "41c98bc0-8d70-4f48-9b70-7fd4287e3ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:05.968833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:05.968299 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:05.968833 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.968446 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:05.968833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:05.968298 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:05.968833 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.968559 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:05.968833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:05.968616 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:05.968833 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:05.968687 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:07.969081 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:07.969033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:07.969525 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:07.969033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:07.969525 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:07.969173 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:07.969525 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:07.969183 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:07.969525 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:07.969306 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:07.969525 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:07.969415 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:09.669421 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:09.669379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:09.669421 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:09.669427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:09.669460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.669517 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.669552 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.669574 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret podName:ddd00b50-9a74-4d9a-a5e8-ce1986cdc942 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:17.669557827 +0000 UTC m=+18.193974095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret") pod "global-pull-secret-syncer-pv9mz" (UID: "ddd00b50-9a74-4d9a-a5e8-ce1986cdc942") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.669601 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs podName:524bf8ca-1381-4b45-9dd4-c4b00152a215 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:17.669584859 +0000 UTC m=+18.194001128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs") pod "network-metrics-daemon-7mjbg" (UID: "524bf8ca-1381-4b45-9dd4-c4b00152a215") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.669604 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.669622 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.669632 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hxvfb for pod openshift-network-diagnostics/network-check-target-gxclc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:09.669856 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.669664 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb podName:41c98bc0-8d70-4f48-9b70-7fd4287e3ee8 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:17.669656047 +0000 UTC m=+18.194072314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxvfb" (UniqueName: "kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb") pod "network-check-target-gxclc" (UID: "41c98bc0-8d70-4f48-9b70-7fd4287e3ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:09.968831 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:09.968762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:09.968831 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:09.968814 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:09.969050 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.968864 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:09.969050 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:09.968919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:09.969149 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.969066 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:09.969214 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:09.969162 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:11.968243 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:11.968205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:11.969981 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:11.968265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:11.969981 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:11.968274 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:11.969981 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:11.968364 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:11.969981 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:11.968503 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:11.969981 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:11.968592 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:12.005705 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:12.005667 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"51528ea83eda14d192d50d6c1bad1e46","Type":"ContainerStarted","Data":"0ab78aa3b96a5292eee5d27c4f96a69370bd6a6c98a9bb40b5bc05ff9914138c"} Sep 07 12:10:12.008295 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:12.008269 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" event={"ID":"9f328a84a0fd2509d73f64d83dcb2186","Type":"ContainerStarted","Data":"a3d40f39da5a2ddbaed42e077f25c9983edbd5a964f1ada7c43ff7387b5db17b"} Sep 07 12:10:13.012758 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:13.012485 2577 generic.go:356] "Generic (PLEG): container finished" podID="51528ea83eda14d192d50d6c1bad1e46" containerID="0ab78aa3b96a5292eee5d27c4f96a69370bd6a6c98a9bb40b5bc05ff9914138c" exitCode=0 Sep 07 12:10:13.013167 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:13.012575 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"51528ea83eda14d192d50d6c1bad1e46","Type":"ContainerDied","Data":"0ab78aa3b96a5292eee5d27c4f96a69370bd6a6c98a9bb40b5bc05ff9914138c"} Sep 07 12:10:13.027565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:13.027518 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-190.ec2.internal" podStartSLOduration=12.027499028 podStartE2EDuration="12.027499028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:12.035017607 +0000 UTC m=+12.559433898" watchObservedRunningTime="2026-09-07 12:10:13.027499028 +0000 UTC m=+13.551915317" Sep 07 12:10:13.967670 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:13.967633 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:13.967670 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:13.967650 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:13.967913 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:13.967742 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:13.967913 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:13.967785 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:13.967913 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:13.967857 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:13.968085 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:13.967929 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:15.967753 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:15.967717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:15.968146 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:15.967717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:15.968146 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:15.967842 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:15.968146 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:15.967868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:15.968146 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:15.967990 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:15.968146 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:15.968066 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:17.729272 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:17.729237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:17.729283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:17.729345 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.729406 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.729428 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.729438 2577 projected.go:196] Error preparing data for projected volume kube-api-access-hxvfb for pod openshift-network-diagnostics/network-check-target-gxclc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.729441 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.729448 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.729499 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb podName:41c98bc0-8d70-4f48-9b70-7fd4287e3ee8 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.729479938 +0000 UTC m=+34.253896210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hxvfb" (UniqueName: "kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb") pod "network-check-target-gxclc" (UID: "41c98bc0-8d70-4f48-9b70-7fd4287e3ee8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.729520 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret podName:ddd00b50-9a74-4d9a-a5e8-ce1986cdc942 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.729512248 +0000 UTC m=+34.253928516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret") pod "global-pull-secret-syncer-pv9mz" (UID: "ddd00b50-9a74-4d9a-a5e8-ce1986cdc942") : object "kube-system"/"original-pull-secret" not registered Sep 07 12:10:17.729785 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.729531 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs podName:524bf8ca-1381-4b45-9dd4-c4b00152a215 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.729525371 +0000 UTC m=+34.253941639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs") pod "network-metrics-daemon-7mjbg" (UID: "524bf8ca-1381-4b45-9dd4-c4b00152a215") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 12:10:17.968425 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:17.968392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:17.968604 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:17.968438 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:17.968604 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.968513 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:17.968604 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:17.968400 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:17.968756 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.968634 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:17.968805 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:17.968757 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:19.968023 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:19.967994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:19.968405 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:19.968094 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:19.968405 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:19.968108 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:19.968405 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:19.968140 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:19.968405 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:19.968198 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:19.968405 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:19.968262 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:21.033000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.032725 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nd9tt" event={"ID":"36018ab5-d35b-4664-8270-178d1220665c","Type":"ContainerStarted","Data":"268a2e4e57fdb2e5f5eaf396dd82f38c6274a500bbd2ac1a1e83ae1553754fa7"} Sep 07 12:10:21.034499 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.034475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-545kx" event={"ID":"f0e6aaeb-d135-47e8-9580-adbc6aebce18","Type":"ContainerStarted","Data":"e1d3bb17f745d04c9c05e3105982cbb090cafa594ed25c4eea17bd6e4ee47c63"} Sep 07 12:10:21.036785 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.036755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxjwz" event={"ID":"5281b9b2-ab6e-4a02-877b-e9ebe79f8d83","Type":"ContainerStarted","Data":"2b680c77584f0cb4a710b2410f5cfddfee665fd4e3f4d033adc9424c33c9f3ef"} Sep 07 12:10:21.038573 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.038544 2577 generic.go:356] "Generic (PLEG): container finished" podID="e83a29fa-0986-450f-b369-6b4f79e109ff" containerID="560dba4d6a6faa49ef95383c314ce22edaca9987272145dd18f6706fe083e164" exitCode=0 Sep 07 12:10:21.038679 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.038631 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" event={"ID":"e83a29fa-0986-450f-b369-6b4f79e109ff","Type":"ContainerDied","Data":"560dba4d6a6faa49ef95383c314ce22edaca9987272145dd18f6706fe083e164"} Sep 07 12:10:21.040613 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.040522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" event={"ID":"b253bb79-6c39-4bb2-9dbd-9826b18a83a4","Type":"ContainerStarted","Data":"2fe7898ba034fcffaa208285c3a8f38b20e4e9937d7bbe29306f5a8c21235acb"} Sep 07 12:10:21.044119 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.044092 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"12c23f9f05e4c95ba2e326fe1696f235db718c095b9fbf2770d4662a4976ec00"} Sep 07 12:10:21.044191 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.044153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"c1c199cd4c6c63d4e525a36c3cd4394e5e455afe7ee1847390556f4181888e01"} Sep 07 12:10:21.044191 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.044184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"bd4b79198ecaa39164a05a6eecf5bf816375ff3a11de00a964f2ee4e242f3548"} Sep 07 12:10:21.044256 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.044211 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"f36b5e302e6c287e0ca8b706eed7b7c35420ee95ed4735b742726e346ea60d14"} Sep 07 12:10:21.044256 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.044239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"01230470d93bf0dcf6aacb78c0f7ee13f241a8deb4b95e68ee922681cda88b39"} Sep 07 12:10:21.044389 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.044265 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"63618004caa580b64612dd20741e228783d6feb84fc03adceb91410355a52c4d"} Sep 07 12:10:21.046465 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.046416 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" event={"ID":"51528ea83eda14d192d50d6c1bad1e46","Type":"ContainerStarted","Data":"b726f9a9cb7ddd4ced26ad94f3825796684d5c2d31609c33fcc8f99080533079"} Sep 07 12:10:21.047066 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.047020 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nd9tt" podStartSLOduration=10.482125916 podStartE2EDuration="21.047005506s" totalImagesPullingTime="10.56487959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:21.046534619 +0000 UTC m=+21.570950935" watchObservedRunningTime="2026-09-07 12:10:21.047005506 +0000 UTC m=+21.571421796" Sep 07 12:10:21.048083 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.048064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cg7lx" event={"ID":"886d8775-2c32-4337-95fb-20ee0e597b87","Type":"ContainerStarted","Data":"80cc21d9a498cf716baaad4d740f4cd76e3541af5d050d380fc5216194031626"} Sep 07 12:10:21.049780 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.049758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v4r6m" event={"ID":"c1529f38-3198-4669-88fc-bceae306e488","Type":"ContainerStarted","Data":"c5746884e79e2f80ee1ccba25a3061c6c4eea06c6c6a0bbc90d775474672b59a"} Sep 07 12:10:21.087467 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.087427 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bxjwz" podStartSLOduration=10.512324316 podStartE2EDuration="21.087414865s" totalImagesPullingTime="10.575090549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:21.087087335 +0000 UTC m=+21.611503647" watchObservedRunningTime="2026-09-07 12:10:21.087414865 +0000 UTC m=+21.611831154" Sep 07 12:10:21.087588 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.087494 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-190.ec2.internal" podStartSLOduration=20.08748871 podStartE2EDuration="20.08748871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:21.075651728 +0000 UTC m=+21.600068018" watchObservedRunningTime="2026-09-07 12:10:21.08748871 +0000 UTC m=+21.611905000" Sep 07 12:10:21.100808 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.100774 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-545kx" podStartSLOduration=6.725326218 podStartE2EDuration="21.100763189s" totalImagesPullingTime="14.375436971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:21.100532205 +0000 UTC m=+21.624948495" watchObservedRunningTime="2026-09-07 12:10:21.100763189 +0000 UTC m=+21.625179476" Sep 07 12:10:21.115464 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.115434 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cg7lx" podStartSLOduration=3.380850274 podStartE2EDuration="21.115424343s" totalImagesPullingTime="17.734574069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:21.115187629 +0000 UTC m=+21.639603935" watchObservedRunningTime="2026-09-07 12:10:21.115424343 +0000 UTC m=+21.639840674" Sep 07 12:10:21.137391 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.137349 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v4r6m" podStartSLOduration=3.294976879 podStartE2EDuration="21.137333636s" totalImagesPullingTime="17.842356757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:21.136876284 +0000 UTC m=+21.661292574" watchObservedRunningTime="2026-09-07 12:10:21.137333636 +0000 UTC m=+21.661749927" Sep 07 12:10:21.213366 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.213243 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 12:10:21.441557 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.441523 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:21.967898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.967862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:21.968103 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.967870 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:21.968103 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.967872 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:21.968103 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:21.968029 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:21.968268 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:21.968154 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:21.968268 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:21.968237 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:21.970252 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.970163 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T12:10:21.213362148Z","UUID":"659dc691-4645-4aea-b9bf-b5ddf1cdbe6d","Handler":null,"Name":"","Endpoint":""} Sep 07 12:10:21.972026 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.972007 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 12:10:21.972134 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:21.972035 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 12:10:22.054123 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:22.054090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" event={"ID":"b253bb79-6c39-4bb2-9dbd-9826b18a83a4","Type":"ContainerStarted","Data":"c222ff04a8bee9977efff19a2a7704883d7cb398a1df10c7be1017ae98e3edeb"} Sep 07 12:10:22.055484 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:22.055459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvvg7" event={"ID":"4edcc1b8-b6f4-4b01-a525-6b939f477ca3","Type":"ContainerStarted","Data":"cac9d95d9ac9390e15c5ee0ae256f4b280b9f86885795342fc51768ea34350ff"} Sep 07 12:10:22.071964 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:22.071906 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nvvg7" podStartSLOduration=11.467759819 podStartE2EDuration="22.071894014s" totalImagesPullingTime="10.604134195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:22.071571141 +0000 UTC m=+22.595987430" watchObservedRunningTime="2026-09-07 12:10:22.071894014 +0000 UTC m=+22.596310304" Sep 07 12:10:23.063790 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:23.063760 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"7d1e0431cca73fd788911181371f1eae7c5a511ad84e37e9da13db98893409f8"} Sep 07 12:10:23.967958 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:23.967903 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:23.968105 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:23.967912 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:23.968105 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:23.968064 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:23.968105 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:23.968058 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:23.968234 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:23.968172 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:23.968278 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:23.968256 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:24.067007 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:24.066933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" event={"ID":"b253bb79-6c39-4bb2-9dbd-9826b18a83a4","Type":"ContainerStarted","Data":"e5177089b16b6bc18f7e9ee508f7753b50d402e91a864f879108a127c5d6a08d"} Sep 07 12:10:24.083264 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:24.083222 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5g2zg" podStartSLOduration=10.805277663 podStartE2EDuration="24.083207658s" totalImagesPullingTime="13.277929995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:24.082801914 +0000 UTC m=+24.607218215" watchObservedRunningTime="2026-09-07 12:10:24.083207658 +0000 UTC m=+24.607623947" Sep 07 12:10:24.857598 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:24.857567 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:24.858510 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:24.858486 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:25.074205 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:25.073850 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" event={"ID":"3a252e78-2d91-4150-a5cf-ada5362e9ec2","Type":"ContainerStarted","Data":"ebba01d22129a0d53d03a721973c69c7993a32b2726881056296697c52740b66"} Sep 07 12:10:25.075071 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:25.075042 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cg7lx" Sep 07 12:10:25.103585 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:25.103522 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" podStartSLOduration=7.25503399 podStartE2EDuration="25.103508801s" totalImagesPullingTime="17.848474811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:25.102033268 +0000 UTC m=+25.626449583" watchObservedRunningTime="2026-09-07 12:10:25.103508801 +0000 UTC m=+25.627925091" Sep 07 12:10:25.968131 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:25.968098 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:25.968131 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:25.968115 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:25.968375 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:25.968098 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:25.968375 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:25.968225 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:25.968375 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:25.968332 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:25.968520 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:25.968422 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:26.077100 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.077065 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:26.077654 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.077151 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:26.077654 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.077196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:26.099467 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.099436 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:26.100384 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.100345 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:26.768732 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.768165 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7mjbg"] Sep 07 12:10:26.768732 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.768329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:26.768732 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:26.768426 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:26.774492 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.774464 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pv9mz"] Sep 07 12:10:26.774654 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.774573 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:26.774717 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:26.774669 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:26.775000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.774981 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gxclc"] Sep 07 12:10:26.775094 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:26.775063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:26.775168 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:26.775147 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:27.968025 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:27.967957 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:27.968549 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:27.968054 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:28.082672 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:28.082642 2577 generic.go:356] "Generic (PLEG): container finished" podID="e83a29fa-0986-450f-b369-6b4f79e109ff" containerID="1f5f0da3ecb2bed0827fcd9bee3b01503d80565d256d4326dd1ff200c991cece" exitCode=0 Sep 07 12:10:28.082828 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:28.082719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" event={"ID":"e83a29fa-0986-450f-b369-6b4f79e109ff","Type":"ContainerDied","Data":"1f5f0da3ecb2bed0827fcd9bee3b01503d80565d256d4326dd1ff200c991cece"} Sep 07 12:10:28.967859 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:28.967832 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:28.968129 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:28.967977 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:28.968129 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:28.968004 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:28.968129 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:28.968111 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:29.968584 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:29.968397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:29.969081 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:29.968673 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:30.091214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:30.091184 2577 generic.go:356] "Generic (PLEG): container finished" podID="e83a29fa-0986-450f-b369-6b4f79e109ff" containerID="5a6fb2693e30372b747611dc12ec44b17a7850403231edacdb7b7319f5f7648b" exitCode=0 Sep 07 12:10:30.091356 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:30.091237 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" event={"ID":"e83a29fa-0986-450f-b369-6b4f79e109ff","Type":"ContainerDied","Data":"5a6fb2693e30372b747611dc12ec44b17a7850403231edacdb7b7319f5f7648b"} Sep 07 12:10:30.967683 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:30.967660 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:30.967773 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:30.967670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:30.967773 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:30.967752 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pv9mz" podUID="ddd00b50-9a74-4d9a-a5e8-ce1986cdc942" Sep 07 12:10:30.967870 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:30.967848 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7mjbg" podUID="524bf8ca-1381-4b45-9dd4-c4b00152a215" Sep 07 12:10:31.095598 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:31.095519 2577 generic.go:356] "Generic (PLEG): container finished" podID="e83a29fa-0986-450f-b369-6b4f79e109ff" containerID="0c71b8c38583c8f475a52da30d0e5818e1ba5e6579370ec72709f477c5261408" exitCode=0 Sep 07 12:10:31.095598 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:31.095567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" event={"ID":"e83a29fa-0986-450f-b369-6b4f79e109ff","Type":"ContainerDied","Data":"0c71b8c38583c8f475a52da30d0e5818e1ba5e6579370ec72709f477c5261408"} Sep 07 12:10:31.967808 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:31.967773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:31.968013 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:31.967903 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxclc" podUID="41c98bc0-8d70-4f48-9b70-7fd4287e3ee8" Sep 07 12:10:32.750999 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.750968 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-190.ec2.internal" event="NodeReady" Sep 07 12:10:32.751367 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.751096 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 12:10:32.785263 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.785200 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-647685dbb6-mhbw7"] Sep 07 12:10:32.788658 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.788636 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.791152 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.791130 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 07 12:10:32.791419 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.791401 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dcrgp\"" Sep 07 12:10:32.791591 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.791575 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 07 12:10:32.791756 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.791741 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 07 12:10:32.796486 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.795725 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8"] Sep 07 12:10:32.798292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.797592 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 07 12:10:32.798712 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.798695 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq"] Sep 07 12:10:32.798837 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.798813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8" Sep 07 12:10:32.801372 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.801185 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.801372 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.801189 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.801372 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.801298 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mzw9t\"" Sep 07 12:10:32.803239 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.802151 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8"] Sep 07 12:10:32.803239 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.802415 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:32.804608 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.804593 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fsmff\"" Sep 07 12:10:32.807898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.804847 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 07 12:10:32.807898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.804933 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.807898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.805057 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.807898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.806249 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-msfcx"] Sep 07 12:10:32.807898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.806257 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 07 12:10:32.807898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.806577 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:32.809164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.809146 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-948qh\"" Sep 07 12:10:32.809368 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.809345 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.809472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.809380 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.809472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.809402 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-xk7vd"] Sep 07 12:10:32.809566 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.809556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 07 12:10:32.809710 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.809689 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:32.813478 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.813453 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.813607 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.813582 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j"] Sep 07 12:10:32.813755 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.813741 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:32.818094 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.816658 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf"] Sep 07 12:10:32.818094 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.817006 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 07 12:10:32.818094 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.817400 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 07 12:10:32.818094 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.818036 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9mhc5\"" Sep 07 12:10:32.820378 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.820351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 07 12:10:32.820506 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.820493 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.821030 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.821010 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.821397 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.821380 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:32.822271 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.822252 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cbd82\"" Sep 07 12:10:32.822643 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.822626 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 07 12:10:32.822965 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.822929 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68fb9cd898-bzvx4"] Sep 07 12:10:32.823074 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.823055 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.823467 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.823451 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:32.825253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.825234 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 07 12:10:32.825515 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.825500 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.825726 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.825326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.826206 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826186 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-647685dbb6-mhbw7"] Sep 07 12:10:32.826299 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826224 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8"] Sep 07 12:10:32.826299 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826232 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 07 12:10:32.826299 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826243 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq"] Sep 07 12:10:32.826299 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826258 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mm6gd\"" Sep 07 12:10:32.826507 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826259 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:32.826646 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826262 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8"] Sep 07 12:10:32.826698 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826682 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-xk7vd"] Sep 07 12:10:32.826732 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826706 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf"] Sep 07 12:10:32.826732 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826724 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j"] Sep 07 12:10:32.826796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826744 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-27274"] Sep 07 12:10:32.826847 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.826827 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 07 12:10:32.827051 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.827030 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 07 12:10:32.828507 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.827030 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.828507 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.827351 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.828990 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.828970 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pgkqt\"" Sep 07 12:10:32.829145 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.829122 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 07 12:10:32.831258 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.829421 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 07 12:10:32.831258 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.829443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.831258 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.829730 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 07 12:10:32.831258 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.829817 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.831258 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.829923 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 07 12:10:32.831258 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.830033 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 07 12:10:32.831258 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.829733 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r57zq\"" Sep 07 12:10:32.831606 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.831349 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-swgj9"] Sep 07 12:10:32.832239 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.832223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27274" Sep 07 12:10:32.836127 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.836101 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ntvw6\"" Sep 07 12:10:32.836835 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.836813 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-qhfdn"] Sep 07 12:10:32.837496 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.837477 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 07 12:10:32.837798 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.837780 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.838103 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.838074 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:32.839684 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.838650 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.839684 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.838805 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 12:10:32.840442 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840422 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 12:10:32.840585 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840566 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 12:10:32.840659 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rwpcl\"" Sep 07 12:10:32.840724 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840705 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-msfcx"] Sep 07 12:10:32.840791 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840746 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27274"] Sep 07 12:10:32.840791 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840763 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-swgj9"] Sep 07 12:10:32.840856 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840814 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-qhfdn"] Sep 07 12:10:32.840856 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840833 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-qhfdn" Sep 07 12:10:32.840992 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.840834 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68fb9cd898-bzvx4"] Sep 07 12:10:32.844055 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.843155 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-scvmr\"" Sep 07 12:10:32.844055 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.843208 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 12:10:32.844055 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.843180 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 12:10:32.930728 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.930697 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:32.948436 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948412 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-trusted-ca\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:32.948554 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948450 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c27082b-d48c-45e2-8e89-b2e437457038-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:32.948554 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948521 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:32.948671 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btnvm\" (UniqueName: \"kubernetes.io/projected/ec7ce58e-24ce-45ac-98d6-86225913cc76-kube-api-access-btnvm\") pod \"network-check-source-685456655f-qhfdn\" (UID: \"ec7ce58e-24ce-45ac-98d6-86225913cc76\") " pod="openshift-network-diagnostics/network-check-source-685456655f-qhfdn" Sep 07 12:10:32.948671 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948586 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f0e801c3-29d2-4551-afa1-cac8f60ab159-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:32.948671 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e9e4432-71ac-4a2d-bef4-0f4de3102334-cert\") pod \"ingress-canary-27274\" (UID: \"6e9e4432-71ac-4a2d-bef4-0f4de3102334\") " pod="openshift-ingress-canary/ingress-canary-27274" Sep 07 12:10:32.948671 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:32.948820 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-certificates\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.948820 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948726 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edba9693-13c0-408d-b381-480e11ba4afb-tmp-dir\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:32.948820 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7795859b-24f2-497c-ad22-f6f64ee052b1-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:32.948820 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nq8p\" (UniqueName: \"kubernetes.io/projected/2c27082b-d48c-45e2-8e89-b2e437457038-kube-api-access-9nq8p\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:32.949000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-stats-auth\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:32.949000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.949000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-trusted-ca\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.949000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7795859b-24f2-497c-ad22-f6f64ee052b1-serving-cert\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:32.949000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.948962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-config\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:32.949203 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dswm\" (UniqueName: \"kubernetes.io/projected/edba9693-13c0-408d-b381-480e11ba4afb-kube-api-access-6dswm\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:32.949203 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd9mq\" (UniqueName: \"kubernetes.io/projected/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-kube-api-access-pd9mq\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:32.949203 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvshl\" (UniqueName: \"kubernetes.io/projected/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-kube-api-access-lvshl\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:32.949203 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edba9693-13c0-408d-b381-480e11ba4afb-config-volume\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:32.949203 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:32.949203 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c27082b-d48c-45e2-8e89-b2e437457038-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:32.949446 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mttwh\" (UniqueName: \"kubernetes.io/projected/95e7ce93-4012-4f95-8c8f-f0949b031ca9-kube-api-access-mttwh\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:32.949446 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:32.949446 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-installation-pull-secrets\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.949446 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949321 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-bound-sa-token\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.949446 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7795859b-24f2-497c-ad22-f6f64ee052b1-tmp\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:32.949446 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949408 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sq5k\" (UniqueName: \"kubernetes.io/projected/7795859b-24f2-497c-ad22-f6f64ee052b1-kube-api-access-8sq5k\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:32.949742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949449 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-ca-trust-extracted\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.949742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-275ch\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-kube-api-access-275ch\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.949742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqqr\" (UniqueName: \"kubernetes.io/projected/f0e801c3-29d2-4551-afa1-cac8f60ab159-kube-api-access-dkqqr\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:32.949742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-default-certificate\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:32.949742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4v7z\" (UniqueName: \"kubernetes.io/projected/6e9e4432-71ac-4a2d-bef4-0f4de3102334-kube-api-access-f4v7z\") pod \"ingress-canary-27274\" (UID: \"6e9e4432-71ac-4a2d-bef4-0f4de3102334\") " pod="openshift-ingress-canary/ingress-canary-27274" Sep 07 12:10:32.949742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949654 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:32.949742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949679 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dq2v\" (UniqueName: \"kubernetes.io/projected/f949622d-8482-4580-b561-903730060a47-kube-api-access-4dq2v\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:32.949742 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-image-registry-private-configuration\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:32.950080 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95e7ce93-4012-4f95-8c8f-f0949b031ca9-config\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:32.950080 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb64c\" (UniqueName: \"kubernetes.io/projected/c2b86631-a821-4d90-a42f-f18edd0e74a1-kube-api-access-qb64c\") pod \"volume-data-source-validator-695c895bd6-d5pg8\" (UID: \"c2b86631-a821-4d90-a42f-f18edd0e74a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8" Sep 07 12:10:32.950080 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7795859b-24f2-497c-ad22-f6f64ee052b1-snapshots\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:32.950080 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-serving-cert\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:32.950080 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95e7ce93-4012-4f95-8c8f-f0949b031ca9-serving-cert\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:32.950080 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.949867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7795859b-24f2-497c-ad22-f6f64ee052b1-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:32.967669 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.967647 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:32.967844 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.967825 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:32.970175 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.970143 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 12:10:32.970277 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.970185 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 12:10:32.970277 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:32.970230 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6gzq2\"" Sep 07 12:10:33.013127 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.013088 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:33.051185 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7795859b-24f2-497c-ad22-f6f64ee052b1-snapshots\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.051185 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-serving-cert\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.051185 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95e7ce93-4012-4f95-8c8f-f0949b031ca9-serving-cert\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:33.051416 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7795859b-24f2-497c-ad22-f6f64ee052b1-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-trusted-ca\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c27082b-d48c-45e2-8e89-b2e437457038-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7795859b-24f2-497c-ad22-f6f64ee052b1-snapshots\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051797 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btnvm\" (UniqueName: \"kubernetes.io/projected/ec7ce58e-24ce-45ac-98d6-86225913cc76-kube-api-access-btnvm\") pod \"network-check-source-685456655f-qhfdn\" (UID: \"ec7ce58e-24ce-45ac-98d6-86225913cc76\") " pod="openshift-network-diagnostics/network-check-source-685456655f-qhfdn" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f0e801c3-29d2-4551-afa1-cac8f60ab159-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e9e4432-71ac-4a2d-bef4-0f4de3102334-cert\") pod \"ingress-canary-27274\" (UID: \"6e9e4432-71ac-4a2d-bef4-0f4de3102334\") " pod="openshift-ingress-canary/ingress-canary-27274" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-certificates\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.051930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edba9693-13c0-408d-b381-480e11ba4afb-tmp-dir\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.051973 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.551930539 +0000 UTC m=+34.076346809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : configmap references non-existent config key: service-ca.crt Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7795859b-24f2-497c-ad22-f6f64ee052b1-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nq8p\" (UniqueName: \"kubernetes.io/projected/2c27082b-d48c-45e2-8e89-b2e437457038-kube-api-access-9nq8p\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-stats-auth\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.054854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052079 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-trusted-ca\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7795859b-24f2-497c-ad22-f6f64ee052b1-serving-cert\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-config\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dswm\" (UniqueName: \"kubernetes.io/projected/edba9693-13c0-408d-b381-480e11ba4afb-kube-api-access-6dswm\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7795859b-24f2-497c-ad22-f6f64ee052b1-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd9mq\" (UniqueName: \"kubernetes.io/projected/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-kube-api-access-pd9mq\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvshl\" (UniqueName: \"kubernetes.io/projected/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-kube-api-access-lvshl\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edba9693-13c0-408d-b381-480e11ba4afb-config-volume\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052284 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edba9693-13c0-408d-b381-480e11ba4afb-tmp-dir\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c27082b-d48c-45e2-8e89-b2e437457038-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mttwh\" (UniqueName: \"kubernetes.io/projected/95e7ce93-4012-4f95-8c8f-f0949b031ca9-kube-api-access-mttwh\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-installation-pull-secrets\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052434 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-bound-sa-token\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.055693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052475 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7795859b-24f2-497c-ad22-f6f64ee052b1-tmp\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sq5k\" (UniqueName: \"kubernetes.io/projected/7795859b-24f2-497c-ad22-f6f64ee052b1-kube-api-access-8sq5k\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052529 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-ca-trust-extracted\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-275ch\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-kube-api-access-275ch\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqqr\" (UniqueName: \"kubernetes.io/projected/f0e801c3-29d2-4551-afa1-cac8f60ab159-kube-api-access-dkqqr\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-default-certificate\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4v7z\" (UniqueName: \"kubernetes.io/projected/6e9e4432-71ac-4a2d-bef4-0f4de3102334-kube-api-access-f4v7z\") pod \"ingress-canary-27274\" (UID: \"6e9e4432-71ac-4a2d-bef4-0f4de3102334\") " pod="openshift-ingress-canary/ingress-canary-27274" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dq2v\" (UniqueName: \"kubernetes.io/projected/f949622d-8482-4580-b561-903730060a47-kube-api-access-4dq2v\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052742 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-trusted-ca\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-image-registry-private-configuration\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95e7ce93-4012-4f95-8c8f-f0949b031ca9-config\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.052830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb64c\" (UniqueName: \"kubernetes.io/projected/c2b86631-a821-4d90-a42f-f18edd0e74a1-kube-api-access-qb64c\") pod \"volume-data-source-validator-695c895bd6-d5pg8\" (UID: \"c2b86631-a821-4d90-a42f-f18edd0e74a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.053038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7795859b-24f2-497c-ad22-f6f64ee052b1-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.053195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f0e801c3-29d2-4551-afa1-cac8f60ab159-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.053481 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:10:33.056634 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.053542 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.553524524 +0000 UTC m=+34.077940811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : secret "router-metrics-certs-default" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.053620 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.053638 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647685dbb6-mhbw7: secret "image-registry-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.053685 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls podName:c1ccaa88-dcbe-4776-88a0-6b73e9931cdd nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.553669511 +0000 UTC m=+34.078085786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls") pod "image-registry-647685dbb6-mhbw7" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd") : secret "image-registry-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.053719 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/edba9693-13c0-408d-b381-480e11ba4afb-config-volume\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.054253 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c27082b-d48c-45e2-8e89-b2e437457038-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.054374 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.054469 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls podName:f949622d-8482-4580-b561-903730060a47 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.554451364 +0000 UTC m=+34.078867632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-2zpn8" (UID: "f949622d-8482-4580-b561-903730060a47") : secret "samples-operator-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.054814 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-trusted-ca\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.054816 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-certificates\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.054974 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.055023 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls podName:edba9693-13c0-408d-b381-480e11ba4afb nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.555010306 +0000 UTC m=+34.079426576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls") pod "dns-default-swgj9" (UID: "edba9693-13c0-408d-b381-480e11ba4afb") : secret "dns-default-metrics-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.055091 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7795859b-24f2-497c-ad22-f6f64ee052b1-tmp\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.055233 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.055281 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls podName:f0e801c3-29d2-4551-afa1-cac8f60ab159 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:33.555267986 +0000 UTC m=+34.079684257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8tclq" (UID: "f0e801c3-29d2-4551-afa1-cac8f60ab159") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.055587 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-ca-trust-extracted\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.057432 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.055690 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-config\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.058365 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.056228 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95e7ce93-4012-4f95-8c8f-f0949b031ca9-config\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:33.058365 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.056799 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-serving-cert\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.058999 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.058508 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e9e4432-71ac-4a2d-bef4-0f4de3102334-cert\") pod \"ingress-canary-27274\" (UID: \"6e9e4432-71ac-4a2d-bef4-0f4de3102334\") " pod="openshift-ingress-canary/ingress-canary-27274" Sep 07 12:10:33.058999 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.058829 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-installation-pull-secrets\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.059151 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.059081 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-stats-auth\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.059737 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.059718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-default-certificate\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.059978 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.059959 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7795859b-24f2-497c-ad22-f6f64ee052b1-serving-cert\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.060599 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.060579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c27082b-d48c-45e2-8e89-b2e437457038-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:33.064041 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.063562 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd9mq\" (UniqueName: \"kubernetes.io/projected/3f6383ab-9e3a-44b1-aa58-06f0471b9cac-kube-api-access-pd9mq\") pod \"console-operator-85b454874b-xk7vd\" (UID: \"3f6383ab-9e3a-44b1-aa58-06f0471b9cac\") " pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.064041 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.063838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btnvm\" (UniqueName: \"kubernetes.io/projected/ec7ce58e-24ce-45ac-98d6-86225913cc76-kube-api-access-btnvm\") pod \"network-check-source-685456655f-qhfdn\" (UID: \"ec7ce58e-24ce-45ac-98d6-86225913cc76\") " pod="openshift-network-diagnostics/network-check-source-685456655f-qhfdn" Sep 07 12:10:33.064479 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.064453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-image-registry-private-configuration\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.064924 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.064891 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95e7ce93-4012-4f95-8c8f-f0949b031ca9-serving-cert\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:33.067329 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.067304 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb64c\" (UniqueName: \"kubernetes.io/projected/c2b86631-a821-4d90-a42f-f18edd0e74a1-kube-api-access-qb64c\") pod \"volume-data-source-validator-695c895bd6-d5pg8\" (UID: \"c2b86631-a821-4d90-a42f-f18edd0e74a1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8" Sep 07 12:10:33.068491 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.068450 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvshl\" (UniqueName: \"kubernetes.io/projected/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-kube-api-access-lvshl\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.069193 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.069009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nq8p\" (UniqueName: \"kubernetes.io/projected/2c27082b-d48c-45e2-8e89-b2e437457038-kube-api-access-9nq8p\") pod \"kube-storage-version-migrator-operator-8d7dd4675-rsfhf\" (UID: \"2c27082b-d48c-45e2-8e89-b2e437457038\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:33.069193 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.069153 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sq5k\" (UniqueName: \"kubernetes.io/projected/7795859b-24f2-497c-ad22-f6f64ee052b1-kube-api-access-8sq5k\") pod \"insights-operator-76bcd6ccf5-msfcx\" (UID: \"7795859b-24f2-497c-ad22-f6f64ee052b1\") " pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.069193 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.069173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqqr\" (UniqueName: \"kubernetes.io/projected/f0e801c3-29d2-4551-afa1-cac8f60ab159-kube-api-access-dkqqr\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:33.069365 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.069197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-275ch\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-kube-api-access-275ch\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.069365 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.069202 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-bound-sa-token\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.069457 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.069373 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mttwh\" (UniqueName: \"kubernetes.io/projected/95e7ce93-4012-4f95-8c8f-f0949b031ca9-kube-api-access-mttwh\") pod \"service-ca-operator-859f94c4b-dmq2j\" (UID: \"95e7ce93-4012-4f95-8c8f-f0949b031ca9\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:33.070172 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.070152 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dswm\" (UniqueName: \"kubernetes.io/projected/edba9693-13c0-408d-b381-480e11ba4afb-kube-api-access-6dswm\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:33.070574 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.070558 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4v7z\" (UniqueName: \"kubernetes.io/projected/6e9e4432-71ac-4a2d-bef4-0f4de3102334-kube-api-access-f4v7z\") pod \"ingress-canary-27274\" (UID: \"6e9e4432-71ac-4a2d-bef4-0f4de3102334\") " pod="openshift-ingress-canary/ingress-canary-27274" Sep 07 12:10:33.070869 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.070847 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dq2v\" (UniqueName: \"kubernetes.io/projected/f949622d-8482-4580-b561-903730060a47-kube-api-access-4dq2v\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:33.114254 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.114221 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8" Sep 07 12:10:33.147821 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.147720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" Sep 07 12:10:33.154045 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.154021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:33.161783 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.161763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" Sep 07 12:10:33.169930 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.169908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" Sep 07 12:10:33.186409 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.185802 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-27274" Sep 07 12:10:33.199532 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.199384 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-qhfdn" Sep 07 12:10:33.407501 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.407472 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8"] Sep 07 12:10:33.411055 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:33.411028 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b86631_a821_4d90_a42f_f18edd0e74a1.slice/crio-bb215ad1c0343b18253d92d7fa2506485b42b08065fd6e78ee06c9ed657ad4fb WatchSource:0}: Error finding container bb215ad1c0343b18253d92d7fa2506485b42b08065fd6e78ee06c9ed657ad4fb: Status 404 returned error can't find the container with id bb215ad1c0343b18253d92d7fa2506485b42b08065fd6e78ee06c9ed657ad4fb Sep 07 12:10:33.451251 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.451224 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-msfcx"] Sep 07 12:10:33.459666 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.459644 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j"] Sep 07 12:10:33.463511 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:33.463477 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e7ce93_4012_4f95_8c8f_f0949b031ca9.slice/crio-cc48a510b9f619a264d4dcf5eddb0c7c3a01d60c4c034f8d2c39ed8a60c9af45 WatchSource:0}: Error finding container cc48a510b9f619a264d4dcf5eddb0c7c3a01d60c4c034f8d2c39ed8a60c9af45: Status 404 returned error can't find the container with id cc48a510b9f619a264d4dcf5eddb0c7c3a01d60c4c034f8d2c39ed8a60c9af45 Sep 07 12:10:33.477300 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.477265 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-xk7vd"] Sep 07 12:10:33.479600 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:33.479573 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6383ab_9e3a_44b1_aa58_06f0471b9cac.slice/crio-4a11a6a4a1f1af48f18cfa65e69ff2e2a8f73d951a734ff3f15b3c0fff694cc0 WatchSource:0}: Error finding container 4a11a6a4a1f1af48f18cfa65e69ff2e2a8f73d951a734ff3f15b3c0fff694cc0: Status 404 returned error can't find the container with id 4a11a6a4a1f1af48f18cfa65e69ff2e2a8f73d951a734ff3f15b3c0fff694cc0 Sep 07 12:10:33.481437 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.481330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf"] Sep 07 12:10:33.484531 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:33.484513 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c27082b_d48c_45e2_8e89_b2e437457038.slice/crio-482a0373af3a14e7868adc3e2df60693325d5c90c54f59ced3a3ecc1974c5185 WatchSource:0}: Error finding container 482a0373af3a14e7868adc3e2df60693325d5c90c54f59ced3a3ecc1974c5185: Status 404 returned error can't find the container with id 482a0373af3a14e7868adc3e2df60693325d5c90c54f59ced3a3ecc1974c5185 Sep 07 12:10:33.523232 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.522761 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-qhfdn"] Sep 07 12:10:33.525165 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.525142 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-27274"] Sep 07 12:10:33.525758 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:33.525732 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7ce58e_24ce_45ac_98d6_86225913cc76.slice/crio-33cb49e198f16f24dec7b78a4c7198a8c100a92447c97f224b00252e8b9e7818 WatchSource:0}: Error finding container 33cb49e198f16f24dec7b78a4c7198a8c100a92447c97f224b00252e8b9e7818: Status 404 returned error can't find the container with id 33cb49e198f16f24dec7b78a4c7198a8c100a92447c97f224b00252e8b9e7818 Sep 07 12:10:33.558878 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.558816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.558878 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.558852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:33.559023 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.558895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:33.559023 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.558931 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:33.559023 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.558988 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:34.558968376 +0000 UTC m=+35.083384644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : configmap references non-existent config key: service-ca.crt Sep 07 12:10:33.559023 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.559013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559041 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559040 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559063 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559078 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls podName:f949622d-8482-4580-b561-903730060a47 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:34.55906647 +0000 UTC m=+35.083482756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-2zpn8" (UID: "f949622d-8482-4580-b561-903730060a47") : secret "samples-operator-tls" not found Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559080 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647685dbb6-mhbw7: secret "image-registry-tls" not found Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559103 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls podName:f0e801c3-29d2-4551-afa1-cac8f60ab159 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:34.559085446 +0000 UTC m=+35.083501731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8tclq" (UID: "f0e801c3-29d2-4551-afa1-cac8f60ab159") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559110 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559135 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls podName:c1ccaa88-dcbe-4776-88a0-6b73e9931cdd nodeName:}" failed. No retries permitted until 2026-09-07 12:10:34.55912594 +0000 UTC m=+35.083542211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls") pod "image-registry-647685dbb6-mhbw7" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd") : secret "image-registry-tls" not found Sep 07 12:10:33.559183 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.559156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:33.559521 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559229 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:34.559218094 +0000 UTC m=+35.083634362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : secret "router-metrics-certs-default" not found Sep 07 12:10:33.559521 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559258 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:10:33.559521 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.559309 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls podName:edba9693-13c0-408d-b381-480e11ba4afb nodeName:}" failed. No retries permitted until 2026-09-07 12:10:34.559299423 +0000 UTC m=+35.083715694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls") pod "dns-default-swgj9" (UID: "edba9693-13c0-408d-b381-480e11ba4afb") : secret "dns-default-metrics-tls" not found Sep 07 12:10:33.761408 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.761321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:10:33.762032 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.761429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:33.762032 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.761478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:33.762161 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.762051 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 12:10:33.762161 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:33.762103 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs podName:524bf8ca-1381-4b45-9dd4-c4b00152a215 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:05.762089282 +0000 UTC m=+66.286505550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs") pod "network-metrics-daemon-7mjbg" (UID: "524bf8ca-1381-4b45-9dd4-c4b00152a215") : secret "metrics-daemon-secret" not found Sep 07 12:10:33.765540 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.765507 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddd00b50-9a74-4d9a-a5e8-ce1986cdc942-original-pull-secret\") pod \"global-pull-secret-syncer-pv9mz\" (UID: \"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942\") " pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:33.765741 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.765722 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxvfb\" (UniqueName: \"kubernetes.io/projected/41c98bc0-8d70-4f48-9b70-7fd4287e3ee8-kube-api-access-hxvfb\") pod \"network-check-target-gxclc\" (UID: \"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8\") " pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:33.886740 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.886707 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pv9mz" Sep 07 12:10:33.969188 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.969146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:33.971796 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.971775 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vr2wq\"" Sep 07 12:10:33.979587 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:33.979568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:34.104981 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.104840 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" event={"ID":"3f6383ab-9e3a-44b1-aa58-06f0471b9cac","Type":"ContainerStarted","Data":"4a11a6a4a1f1af48f18cfa65e69ff2e2a8f73d951a734ff3f15b3c0fff694cc0"} Sep 07 12:10:34.106719 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.106639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" event={"ID":"7795859b-24f2-497c-ad22-f6f64ee052b1","Type":"ContainerStarted","Data":"1a3187696dbb9ede56fb0e5b80820375427dcdca1ce945ec79a08d06a6c08eab"} Sep 07 12:10:34.108127 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.108075 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" event={"ID":"2c27082b-d48c-45e2-8e89-b2e437457038","Type":"ContainerStarted","Data":"482a0373af3a14e7868adc3e2df60693325d5c90c54f59ced3a3ecc1974c5185"} Sep 07 12:10:34.110575 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.110518 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27274" event={"ID":"6e9e4432-71ac-4a2d-bef4-0f4de3102334","Type":"ContainerStarted","Data":"9cb854954f5ab20331fe46f94a049018ccc63a076ea6bc366fb20b0a25cc6d65"} Sep 07 12:10:34.112630 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.112581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8" event={"ID":"c2b86631-a821-4d90-a42f-f18edd0e74a1","Type":"ContainerStarted","Data":"bb215ad1c0343b18253d92d7fa2506485b42b08065fd6e78ee06c9ed657ad4fb"} Sep 07 12:10:34.114898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.114872 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-qhfdn" event={"ID":"ec7ce58e-24ce-45ac-98d6-86225913cc76","Type":"ContainerStarted","Data":"33cb49e198f16f24dec7b78a4c7198a8c100a92447c97f224b00252e8b9e7818"} Sep 07 12:10:34.117378 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.117338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" event={"ID":"95e7ce93-4012-4f95-8c8f-f0949b031ca9","Type":"ContainerStarted","Data":"cc48a510b9f619a264d4dcf5eddb0c7c3a01d60c4c034f8d2c39ed8a60c9af45"} Sep 07 12:10:34.165393 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.164193 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pv9mz"] Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.572013 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.572067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.572104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.572140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.572174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.572223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.572360 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.572423 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls podName:edba9693-13c0-408d-b381-480e11ba4afb nodeName:}" failed. No retries permitted until 2026-09-07 12:10:36.572405144 +0000 UTC m=+37.096821416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls") pod "dns-default-swgj9" (UID: "edba9693-13c0-408d-b381-480e11ba4afb") : secret "dns-default-metrics-tls" not found Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573127 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:36.573110017 +0000 UTC m=+37.097526300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : configmap references non-existent config key: service-ca.crt Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573201 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573235 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls podName:f0e801c3-29d2-4551-afa1-cac8f60ab159 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:36.573224638 +0000 UTC m=+37.097640923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8tclq" (UID: "f0e801c3-29d2-4551-afa1-cac8f60ab159") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573318 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573330 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647685dbb6-mhbw7: secret "image-registry-tls" not found Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573361 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls podName:c1ccaa88-dcbe-4776-88a0-6b73e9931cdd nodeName:}" failed. No retries permitted until 2026-09-07 12:10:36.573350709 +0000 UTC m=+37.097766983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls") pod "image-registry-647685dbb6-mhbw7" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd") : secret "image-registry-tls" not found Sep 07 12:10:34.573619 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573413 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:10:34.574534 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573443 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls podName:f949622d-8482-4580-b561-903730060a47 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:36.573432569 +0000 UTC m=+37.097848856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-2zpn8" (UID: "f949622d-8482-4580-b561-903730060a47") : secret "samples-operator-tls" not found Sep 07 12:10:34.574534 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573502 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:10:34.574534 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:34.573534 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:36.573522628 +0000 UTC m=+37.097938901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : secret "router-metrics-certs-default" not found Sep 07 12:10:34.818845 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.818639 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:34.993990 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.992865 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tj2gj"] Sep 07 12:10:34.996983 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:34.996605 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:35.001457 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.000568 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-d2lwf\"" Sep 07 12:10:35.001457 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.000784 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 07 12:10:35.001457 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.001031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 07 12:10:35.003503 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.003338 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tj2gj"] Sep 07 12:10:35.117405 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.117352 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:35.177957 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.177916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2cf7c2d9-0396-4849-b25d-621ed1675bc7-nginx-conf\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:35.178137 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.178002 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:35.226103 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.226066 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:35.276403 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.276329 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:35.278899 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.278451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2cf7c2d9-0396-4849-b25d-621ed1675bc7-nginx-conf\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:35.278899 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.278489 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:35.278899 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:35.278633 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:10:35.278899 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:35.278677 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert podName:2cf7c2d9-0396-4849-b25d-621ed1675bc7 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:35.778664659 +0000 UTC m=+36.303080927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tj2gj" (UID: "2cf7c2d9-0396-4849-b25d-621ed1675bc7") : secret "networking-console-plugin-cert" not found Sep 07 12:10:35.279420 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.279370 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2cf7c2d9-0396-4849-b25d-621ed1675bc7-nginx-conf\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:35.783722 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:35.783687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:35.783889 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:35.783857 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:10:35.783936 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:35.783920 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert podName:2cf7c2d9-0396-4849-b25d-621ed1675bc7 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:36.783900989 +0000 UTC m=+37.308317261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tj2gj" (UID: "2cf7c2d9-0396-4849-b25d-621ed1675bc7") : secret "networking-console-plugin-cert" not found Sep 07 12:10:36.590111 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:36.590073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:36.590119 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:36.590156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:36.590192 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:36.590223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590273 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590278 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:40.590253099 +0000 UTC m=+41.114669387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : configmap references non-existent config key: service-ca.crt Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590323 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590351 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590366 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls podName:f0e801c3-29d2-4551-afa1-cac8f60ab159 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:40.590343629 +0000 UTC m=+41.114759908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8tclq" (UID: "f0e801c3-29d2-4551-afa1-cac8f60ab159") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590390 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:40.590377113 +0000 UTC m=+41.114793380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : secret "router-metrics-certs-default" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590406 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls podName:f949622d-8482-4580-b561-903730060a47 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:40.590397949 +0000 UTC m=+41.114814219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-2zpn8" (UID: "f949622d-8482-4580-b561-903730060a47") : secret "samples-operator-tls" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590409 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590426 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647685dbb6-mhbw7: secret "image-registry-tls" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:36.590438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590477 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls podName:c1ccaa88-dcbe-4776-88a0-6b73e9931cdd nodeName:}" failed. No retries permitted until 2026-09-07 12:10:40.590470829 +0000 UTC m=+41.114887097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls") pod "image-registry-647685dbb6-mhbw7" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd") : secret "image-registry-tls" not found Sep 07 12:10:36.590672 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590540 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:10:36.591241 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.590578 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls podName:edba9693-13c0-408d-b381-480e11ba4afb nodeName:}" failed. No retries permitted until 2026-09-07 12:10:40.590562817 +0000 UTC m=+41.114979097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls") pod "dns-default-swgj9" (UID: "edba9693-13c0-408d-b381-480e11ba4afb") : secret "dns-default-metrics-tls" not found Sep 07 12:10:36.791985 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:36.791932 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:36.792208 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.792192 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:10:36.792274 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:36.792262 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert podName:2cf7c2d9-0396-4849-b25d-621ed1675bc7 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:38.792241425 +0000 UTC m=+39.316657710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tj2gj" (UID: "2cf7c2d9-0396-4849-b25d-621ed1675bc7") : secret "networking-console-plugin-cert" not found Sep 07 12:10:36.906618 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:36.906558 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:36.991684 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:36.991646 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd00b50_9a74_4d9a_a5e8_ce1986cdc942.slice/crio-65fc5705bacf3e9b72f5c1bb8230fd65437924647c6753a3775962609110662b WatchSource:0}: Error finding container 65fc5705bacf3e9b72f5c1bb8230fd65437924647c6753a3775962609110662b: Status 404 returned error can't find the container with id 65fc5705bacf3e9b72f5c1bb8230fd65437924647c6753a3775962609110662b Sep 07 12:10:37.127475 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:37.127429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pv9mz" event={"ID":"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942","Type":"ContainerStarted","Data":"65fc5705bacf3e9b72f5c1bb8230fd65437924647c6753a3775962609110662b"} Sep 07 12:10:37.967497 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:37.967331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:38.022126 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:38.022099 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:38.810481 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:38.810449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:38.810659 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:38.810591 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:10:38.810722 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:38.810664 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert podName:2cf7c2d9-0396-4849-b25d-621ed1675bc7 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:42.810644323 +0000 UTC m=+43.335060606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tj2gj" (UID: "2cf7c2d9-0396-4849-b25d-621ed1675bc7") : secret "networking-console-plugin-cert" not found Sep 07 12:10:38.893773 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:38.893738 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:39.204038 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:39.203989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:39.251812 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:39.251773 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:40.625808 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:40.625765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:40.626308 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:40.625814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:40.626391 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:40.626372 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:40.626465 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626406 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:40.626465 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626449 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:48.626410194 +0000 UTC m=+49.150826485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : configmap references non-existent config key: service-ca.crt Sep 07 12:10:40.626579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:40.626483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:40.626579 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626504 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls podName:f0e801c3-29d2-4551-afa1-cac8f60ab159 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:48.626484546 +0000 UTC m=+49.150900837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8tclq" (UID: "f0e801c3-29d2-4551-afa1-cac8f60ab159") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:40.626579 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626507 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:10:40.626579 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626524 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647685dbb6-mhbw7: secret "image-registry-tls" not found Sep 07 12:10:40.626579 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626565 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:10:40.626579 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626576 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls podName:c1ccaa88-dcbe-4776-88a0-6b73e9931cdd nodeName:}" failed. No retries permitted until 2026-09-07 12:10:48.626560429 +0000 UTC m=+49.150976712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls") pod "image-registry-647685dbb6-mhbw7" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd") : secret "image-registry-tls" not found Sep 07 12:10:40.626579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:40.626571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:40.626936 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626604 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls podName:f949622d-8482-4580-b561-903730060a47 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:48.626594024 +0000 UTC m=+49.151010291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-2zpn8" (UID: "f949622d-8482-4580-b561-903730060a47") : secret "samples-operator-tls" not found Sep 07 12:10:40.626936 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:40.626654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:40.626936 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626750 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:10:40.626936 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.626785 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls podName:edba9693-13c0-408d-b381-480e11ba4afb nodeName:}" failed. No retries permitted until 2026-09-07 12:10:48.62677652 +0000 UTC m=+49.151192788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls") pod "dns-default-swgj9" (UID: "edba9693-13c0-408d-b381-480e11ba4afb") : secret "dns-default-metrics-tls" not found Sep 07 12:10:40.627182 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.627149 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:10:40.627232 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:40.627208 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:48.62719285 +0000 UTC m=+49.151609122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : secret "router-metrics-certs-default" not found Sep 07 12:10:41.042769 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:41.042735 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gxclc"] Sep 07 12:10:42.846789 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:42.846738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:42.847215 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:42.846900 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:10:42.847215 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:42.846975 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert podName:2cf7c2d9-0396-4849-b25d-621ed1675bc7 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:50.84696032 +0000 UTC m=+51.371376589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tj2gj" (UID: "2cf7c2d9-0396-4849-b25d-621ed1675bc7") : secret "networking-console-plugin-cert" not found Sep 07 12:10:43.593363 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:10:43.591659 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c98bc0_8d70_4f48_9b70_7fd4287e3ee8.slice/crio-d633c40820535d79b6c54bc7a359d798c5e1e3c853d5be6e9bcaefd5d9e6bcc5 WatchSource:0}: Error finding container d633c40820535d79b6c54bc7a359d798c5e1e3c853d5be6e9bcaefd5d9e6bcc5: Status 404 returned error can't find the container with id d633c40820535d79b6c54bc7a359d798c5e1e3c853d5be6e9bcaefd5d9e6bcc5 Sep 07 12:10:44.101292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:44.101258 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:44.147956 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:44.147918 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gxclc" event={"ID":"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8","Type":"ContainerStarted","Data":"d633c40820535d79b6c54bc7a359d798c5e1e3c853d5be6e9bcaefd5d9e6bcc5"} Sep 07 12:10:44.201918 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:44.201881 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:45.156175 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.156084 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" event={"ID":"95e7ce93-4012-4f95-8c8f-f0949b031ca9","Type":"ContainerStarted","Data":"c7dd5b3a544cc02ac37027191e62fcbc16f164dfa136667613933f51dd522b0d"} Sep 07 12:10:45.158197 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.158172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/0.log" Sep 07 12:10:45.158348 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.158211 2577 generic.go:356] "Generic (PLEG): container finished" podID="3f6383ab-9e3a-44b1-aa58-06f0471b9cac" containerID="9b8221cf348d9de1f9a3ac4eadeae12b05e4915b0dbc43bdce7e5c6e687498c5" exitCode=255 Sep 07 12:10:45.158656 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.158433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" event={"ID":"3f6383ab-9e3a-44b1-aa58-06f0471b9cac","Type":"ContainerDied","Data":"9b8221cf348d9de1f9a3ac4eadeae12b05e4915b0dbc43bdce7e5c6e687498c5"} Sep 07 12:10:45.158656 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.158541 2577 scope.go:117] "RemoveContainer" containerID="9b8221cf348d9de1f9a3ac4eadeae12b05e4915b0dbc43bdce7e5c6e687498c5" Sep 07 12:10:45.161638 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.160849 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" event={"ID":"7795859b-24f2-497c-ad22-f6f64ee052b1","Type":"ContainerStarted","Data":"6f594d9c8431fa6c437192d7e854122f0e3235acfd94255d2b74719a05e25e18"} Sep 07 12:10:45.163407 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.163384 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" event={"ID":"2c27082b-d48c-45e2-8e89-b2e437457038","Type":"ContainerStarted","Data":"5980775f39855df00a8514e31da5896b6e2dd6d995c1095565d0c1edb3e79904"} Sep 07 12:10:45.166278 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.166259 2577 generic.go:356] "Generic (PLEG): container finished" podID="e83a29fa-0986-450f-b369-6b4f79e109ff" containerID="9513f70ccbcf0e0544e69efc9ca2afa9cc0c9c31b9e81c1826ef5ec69de05b2f" exitCode=0 Sep 07 12:10:45.166372 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.166339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" event={"ID":"e83a29fa-0986-450f-b369-6b4f79e109ff","Type":"ContainerDied","Data":"9513f70ccbcf0e0544e69efc9ca2afa9cc0c9c31b9e81c1826ef5ec69de05b2f"} Sep 07 12:10:45.168323 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.168298 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-27274" event={"ID":"6e9e4432-71ac-4a2d-bef4-0f4de3102334","Type":"ContainerStarted","Data":"3f0dad1770a1c495a72f2ae4b5499f6a9e8e912b2c7ed95da45705b1e3b43b78"} Sep 07 12:10:45.173874 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.172706 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8" event={"ID":"c2b86631-a821-4d90-a42f-f18edd0e74a1","Type":"ContainerStarted","Data":"1892ed4367b670fe6a13b7a25e89303f24dc9e206aebf32b2fbccbfe0a79ed54"} Sep 07 12:10:45.174837 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.174814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pv9mz" event={"ID":"ddd00b50-9a74-4d9a-a5e8-ce1986cdc942","Type":"ContainerStarted","Data":"f0d5b172423a77593bf967638aa11048ace943664e393b69b5d615ca13889bdc"} Sep 07 12:10:45.177597 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.177575 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-qhfdn" event={"ID":"ec7ce58e-24ce-45ac-98d6-86225913cc76","Type":"ContainerStarted","Data":"97da747330c2b14c5733d377de45b76e456f1572d20610fac74551f6ab653bd7"} Sep 07 12:10:45.180475 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.180451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gxclc" event={"ID":"41c98bc0-8d70-4f48-9b70-7fd4287e3ee8","Type":"ContainerStarted","Data":"502d915e96405ca067b53c09902f72f0ca4f3e0f8f0a5a2e03d850db0ccfe0e0"} Sep 07 12:10:45.196230 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.195855 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:10:45.198102 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.196742 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" podStartSLOduration=28.880021434 podStartE2EDuration="36.196726661s" totalImagesPullingTime="7.316705227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:45.170898677 +0000 UTC m=+45.695314968" watchObservedRunningTime="2026-09-07 12:10:45.196726661 +0000 UTC m=+45.721142950" Sep 07 12:10:45.213929 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.213874 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" podStartSLOduration=25.598373511 podStartE2EDuration="36.213857983s" totalImagesPullingTime="10.615484472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:45.212889925 +0000 UTC m=+45.737306240" watchObservedRunningTime="2026-09-07 12:10:45.213857983 +0000 UTC m=+45.738274279" Sep 07 12:10:45.234374 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.229721 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" podStartSLOduration=25.555491698 podStartE2EDuration="36.229703188s" totalImagesPullingTime="10.67421149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:45.22914863 +0000 UTC m=+45.753564945" watchObservedRunningTime="2026-09-07 12:10:45.229703188 +0000 UTC m=+45.754119508" Sep 07 12:10:45.242438 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.242413 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cmb5f"] Sep 07 12:10:45.287150 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.287058 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:45.289562 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.287925 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-27274" podStartSLOduration=2.748820001 podStartE2EDuration="13.287905539s" totalImagesPullingTime="10.539085538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:45.28608258 +0000 UTC m=+45.810498874" watchObservedRunningTime="2026-09-07 12:10:45.287905539 +0000 UTC m=+45.812321830" Sep 07 12:10:45.293139 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.293115 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmb5f"] Sep 07 12:10:45.293384 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.293367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.296517 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.295734 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 12:10:45.296517 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.296034 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gpkr9\"" Sep 07 12:10:45.296517 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.296248 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 12:10:45.310176 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.309843 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gxclc" podStartSLOduration=45.309825464 podStartE2EDuration="45.309825464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:45.302368975 +0000 UTC m=+45.826785286" watchObservedRunningTime="2026-09-07 12:10:45.309825464 +0000 UTC m=+45.834241757" Sep 07 12:10:45.335975 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.335033 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pv9mz" podStartSLOduration=38.1688877 podStartE2EDuration="45.335014336s" totalImagesPullingTime="7.166126636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:45.32098746 +0000 UTC m=+45.845403761" watchObservedRunningTime="2026-09-07 12:10:45.335014336 +0000 UTC m=+45.859430618" Sep 07 12:10:45.336105 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.336013 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-d5pg8" podStartSLOduration=25.588771155 podStartE2EDuration="36.336004213s" totalImagesPullingTime="10.747233058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:45.334768579 +0000 UTC m=+45.859184870" watchObservedRunningTime="2026-09-07 12:10:45.336004213 +0000 UTC m=+45.860420502" Sep 07 12:10:45.371532 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.371484 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-qhfdn" podStartSLOduration=25.829687943 podStartE2EDuration="36.371466427s" totalImagesPullingTime="10.541778484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:45.351190034 +0000 UTC m=+45.875606325" watchObservedRunningTime="2026-09-07 12:10:45.371466427 +0000 UTC m=+45.895882720" Sep 07 12:10:45.381515 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.381488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87b0147c-1cfb-4c8b-869f-e6bf155e0971-data-volume\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.381641 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.381623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.381737 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.381710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87b0147c-1cfb-4c8b-869f-e6bf155e0971-crio-socket\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.381799 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.381759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.381848 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.381805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqst8\" (UniqueName: \"kubernetes.io/projected/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-api-access-lqst8\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.411352 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.411251 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:45.482988 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.482956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87b0147c-1cfb-4c8b-869f-e6bf155e0971-data-volume\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.483120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.483010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.483120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.483086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87b0147c-1cfb-4c8b-869f-e6bf155e0971-crio-socket\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.483240 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.483169 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87b0147c-1cfb-4c8b-869f-e6bf155e0971-crio-socket\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.483240 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:45.483192 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:10:45.483333 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.483260 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87b0147c-1cfb-4c8b-869f-e6bf155e0971-data-volume\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.483380 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:45.483352 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:45.9832448 +0000 UTC m=+46.507661073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : secret "insights-runtime-extractor-tls" not found Sep 07 12:10:45.483442 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.483407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.483498 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.483454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqst8\" (UniqueName: \"kubernetes.io/projected/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-api-access-lqst8\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.483647 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:45.483617 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:10:45.483759 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:45.483674 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:45.983660657 +0000 UTC m=+46.508076943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : configmap "kube-rbac-proxy" not found Sep 07 12:10:45.491653 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.491632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqst8\" (UniqueName: \"kubernetes.io/projected/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-api-access-lqst8\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.509717 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.509684 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:45.936654 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.936613 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:45.989415 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.989388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.989594 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:45.989483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:45.989594 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:45.989527 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:10:45.989594 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:45.989566 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:10:45.989716 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:45.989601 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:46.989580716 +0000 UTC m=+47.513996985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : configmap "kube-rbac-proxy" not found Sep 07 12:10:45.989716 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:45.989620 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:46.989611761 +0000 UTC m=+47.514028030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : secret "insights-runtime-extractor-tls" not found Sep 07 12:10:46.037322 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.037286 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:46.187511 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.187441 2577 generic.go:356] "Generic (PLEG): container finished" podID="e83a29fa-0986-450f-b369-6b4f79e109ff" containerID="d830375d4488dd5a4339c7da8880cf4f81c35e99cd146f32a322f507d3cbef02" exitCode=0 Sep 07 12:10:46.187897 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.187541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" event={"ID":"e83a29fa-0986-450f-b369-6b4f79e109ff","Type":"ContainerDied","Data":"d830375d4488dd5a4339c7da8880cf4f81c35e99cd146f32a322f507d3cbef02"} Sep 07 12:10:46.189256 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.189236 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/1.log" Sep 07 12:10:46.189629 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.189614 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/0.log" Sep 07 12:10:46.189692 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.189645 2577 generic.go:356] "Generic (PLEG): container finished" podID="3f6383ab-9e3a-44b1-aa58-06f0471b9cac" containerID="37fadc9860a0572aea3a183a2e8e819eb21f7fc79d7c2b273a8f844f589dc7ae" exitCode=255 Sep 07 12:10:46.189789 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.189766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" event={"ID":"3f6383ab-9e3a-44b1-aa58-06f0471b9cac","Type":"ContainerDied","Data":"37fadc9860a0572aea3a183a2e8e819eb21f7fc79d7c2b273a8f844f589dc7ae"} Sep 07 12:10:46.189833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.189819 2577 scope.go:117] "RemoveContainer" containerID="9b8221cf348d9de1f9a3ac4eadeae12b05e4915b0dbc43bdce7e5c6e687498c5" Sep 07 12:10:46.189919 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.189901 2577 scope.go:117] "RemoveContainer" containerID="37fadc9860a0572aea3a183a2e8e819eb21f7fc79d7c2b273a8f844f589dc7ae" Sep 07 12:10:46.190145 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:46.190109 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-xk7vd_openshift-console-operator(3f6383ab-9e3a-44b1-aa58-06f0471b9cac)\"" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" podUID="3f6383ab-9e3a-44b1-aa58-06f0471b9cac" Sep 07 12:10:46.216600 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.216574 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:46.272037 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.272004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:46.576208 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.576121 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:46.850643 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.850609 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:46.936425 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.936393 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:46.999732 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.999705 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:46.999868 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:46.999819 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:10:46.999868 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:46.999822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:47.000038 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:46.999878 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:48.999860155 +0000 UTC m=+49.524276426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : configmap "kube-rbac-proxy" not found Sep 07 12:10:47.000038 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:46.999921 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:10:47.000038 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:46.999984 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:48.999971624 +0000 UTC m=+49.524387892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : secret "insights-runtime-extractor-tls" not found Sep 07 12:10:47.024647 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:47.024625 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nd9tt_36018ab5-d35b-4664-8270-178d1220665c/dns-node-resolver/0.log" Sep 07 12:10:47.197082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:47.197024 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/1.log" Sep 07 12:10:47.197446 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:47.197341 2577 scope.go:117] "RemoveContainer" containerID="37fadc9860a0572aea3a183a2e8e819eb21f7fc79d7c2b273a8f844f589dc7ae" Sep 07 12:10:47.197538 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:47.197514 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-xk7vd_openshift-console-operator(3f6383ab-9e3a-44b1-aa58-06f0471b9cac)\"" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" podUID="3f6383ab-9e3a-44b1-aa58-06f0471b9cac" Sep 07 12:10:47.200838 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:47.200812 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" event={"ID":"e83a29fa-0986-450f-b369-6b4f79e109ff","Type":"ContainerStarted","Data":"56780463fb71715fe7ecf75ed3fd2185953930bad33bea4e3fdf28015948e568"} Sep 07 12:10:47.231214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:47.231173 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rkvs9" podStartSLOduration=15.699481482 podStartE2EDuration="47.23116114s" totalImagesPullingTime="31.531679658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:10:47.229837539 +0000 UTC m=+47.754253850" watchObservedRunningTime="2026-09-07 12:10:47.23116114 +0000 UTC m=+47.755577451" Sep 07 12:10:47.357492 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:47.357454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:47.459667 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:47.459601 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:48.024032 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.024007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxjwz_5281b9b2-ab6e-4a02-877b-e9ebe79f8d83/node-ca/0.log" Sep 07 12:10:48.424427 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.424401 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27274_6e9e4432-71ac-4a2d-bef4-0f4de3102334/serve-healthcheck-canary/0.log" Sep 07 12:10:48.503120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.503089 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:48.563443 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.563406 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:48.663993 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.663960 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:48.714216 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.714157 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:48.714216 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.714188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:10:48.714216 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.714211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:10:48.714373 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714298 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 07 12:10:48.714373 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714299 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:48.714373 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714308 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647685dbb6-mhbw7: secret "image-registry-tls" not found Sep 07 12:10:48.714373 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714309 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:04.7142942 +0000 UTC m=+65.238710498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : configmap references non-existent config key: service-ca.crt Sep 07 12:10:48.714373 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714354 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls podName:c1ccaa88-dcbe-4776-88a0-6b73e9931cdd nodeName:}" failed. No retries permitted until 2026-09-07 12:11:04.714343105 +0000 UTC m=+65.238759373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls") pod "image-registry-647685dbb6-mhbw7" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd") : secret "image-registry-tls" not found Sep 07 12:10:48.714373 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714371 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls podName:f0e801c3-29d2-4551-afa1-cac8f60ab159 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:04.714359625 +0000 UTC m=+65.238775896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-8tclq" (UID: "f0e801c3-29d2-4551-afa1-cac8f60ab159") : secret "cluster-monitoring-operator-tls" not found Sep 07 12:10:48.714553 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.714391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:10:48.714553 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.714424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:10:48.714553 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714452 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 07 12:10:48.714553 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.714470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:10:48.714553 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714483 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls podName:f949622d-8482-4580-b561-903730060a47 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:04.714474181 +0000 UTC m=+65.238890449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-2zpn8" (UID: "f949622d-8482-4580-b561-903730060a47") : secret "samples-operator-tls" not found Sep 07 12:10:48.714553 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714524 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 12:10:48.714553 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714535 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 07 12:10:48.714553 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714548 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls podName:edba9693-13c0-408d-b381-480e11ba4afb nodeName:}" failed. No retries permitted until 2026-09-07 12:11:04.714541481 +0000 UTC m=+65.238957749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls") pod "dns-default-swgj9" (UID: "edba9693-13c0-408d-b381-480e11ba4afb") : secret "dns-default-metrics-tls" not found Sep 07 12:10:48.714798 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:48.714564 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs podName:68e5dd72-77d2-40c3-94ea-f99bb3dc3387 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:04.714553601 +0000 UTC m=+65.238969868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs") pod "router-default-68fb9cd898-bzvx4" (UID: "68e5dd72-77d2-40c3-94ea-f99bb3dc3387") : secret "router-metrics-certs-default" not found Sep 07 12:10:48.979315 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:48.979230 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:49.017593 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:49.017565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:49.017712 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:49.017625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:49.017759 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:49.017714 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 12:10:49.017759 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:49.017717 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:10:49.017836 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:49.017762 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:53.017749137 +0000 UTC m=+53.542165405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : configmap "kube-rbac-proxy" not found Sep 07 12:10:49.017836 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:49.017773 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:10:53.017767467 +0000 UTC m=+53.542183734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : secret "insights-runtime-extractor-tls" not found Sep 07 12:10:49.080584 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:49.080555 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:50.198289 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:50.198245 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:50.299214 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:50.299155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:50.933246 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:50.933207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:10:50.933526 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:50.933345 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 07 12:10:50.933526 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:50.933419 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert podName:2cf7c2d9-0396-4849-b25d-621ed1675bc7 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:06.933396365 +0000 UTC m=+67.457812635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tj2gj" (UID: "2cf7c2d9-0396-4849-b25d-621ed1675bc7") : secret "networking-console-plugin-cert" not found Sep 07 12:10:53.051700 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.051664 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:53.052147 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.051729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:53.052147 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:53.051811 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 12:10:53.052147 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:53.051866 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls podName:87b0147c-1cfb-4c8b-869f-e6bf155e0971 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:01.051852742 +0000 UTC m=+61.576269013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmb5f" (UID: "87b0147c-1cfb-4c8b-869f-e6bf155e0971") : secret "insights-runtime-extractor-tls" not found Sep 07 12:10:53.052259 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.052159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87b0147c-1cfb-4c8b-869f-e6bf155e0971-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:10:53.154604 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.154572 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:53.154698 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.154627 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:10:53.154933 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.154922 2577 scope.go:117] "RemoveContainer" containerID="37fadc9860a0572aea3a183a2e8e819eb21f7fc79d7c2b273a8f844f589dc7ae" Sep 07 12:10:53.155092 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:10:53.155076 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-xk7vd_openshift-console-operator(3f6383ab-9e3a-44b1-aa58-06f0471b9cac)\"" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" podUID="3f6383ab-9e3a-44b1-aa58-06f0471b9cac" Sep 07 12:10:53.258854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.258819 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:53.560149 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.560109 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:53.660622 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.660580 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:53.762215 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.762180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:53.866576 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.866537 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:53.974937 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:53.974911 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:54.064340 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:54.064307 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:54.463179 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:54.463144 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:54.860560 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:54.860530 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:55.260932 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:55.260847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:55.882364 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:55.882334 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:56.259522 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:56.259439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:56.360884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:56.360855 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:56.658862 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:56.658821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:56.935541 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:56.935461 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:57.058658 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:57.058624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:57.258937 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:57.258867 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:57.307828 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:57.307806 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:57.643641 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:57.643615 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:57.696065 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:57.696017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:58.097014 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:58.096991 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-92kzn" Sep 07 12:10:58.524853 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:58.524775 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:58.645740 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:58.645712 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:58.858101 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:58.858072 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:59.752013 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:59.751984 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:10:59.852587 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:10:59.852559 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:00.063288 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:00.063214 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:00.656323 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:00.656288 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:00.830557 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:00.830527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:01.118494 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.118467 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:11:01.120723 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.120699 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87b0147c-1cfb-4c8b-869f-e6bf155e0971-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmb5f\" (UID: \"87b0147c-1cfb-4c8b-869f-e6bf155e0971\") " pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:11:01.222907 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.222876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gpkr9\"" Sep 07 12:11:01.231265 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.231242 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmb5f" Sep 07 12:11:01.258265 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.258237 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:01.461478 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.461396 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:01.528036 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.528002 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmb5f"] Sep 07 12:11:01.531511 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:01.531468 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b0147c_1cfb_4c8b_869f_e6bf155e0971.slice/crio-83004f0828e73afc5dce3a49ce1870ca4bc0ba3d43a8f7751e87060f89c00430 WatchSource:0}: Error finding container 83004f0828e73afc5dce3a49ce1870ca4bc0ba3d43a8f7751e87060f89c00430: Status 404 returned error can't find the container with id 83004f0828e73afc5dce3a49ce1870ca4bc0ba3d43a8f7751e87060f89c00430 Sep 07 12:11:01.704937 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.704890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:01.860637 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:01.860594 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:02.250963 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:02.250866 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmb5f" event={"ID":"87b0147c-1cfb-4c8b-869f-e6bf155e0971","Type":"ContainerStarted","Data":"459f63645b2b67d29bbee16b892e30b2b99068073d348e30410dd1baec86726a"} Sep 07 12:11:02.250963 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:02.250917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmb5f" event={"ID":"87b0147c-1cfb-4c8b-869f-e6bf155e0971","Type":"ContainerStarted","Data":"83004f0828e73afc5dce3a49ce1870ca4bc0ba3d43a8f7751e87060f89c00430"} Sep 07 12:11:03.059532 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:03.059454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:03.256005 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:03.255968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmb5f" event={"ID":"87b0147c-1cfb-4c8b-869f-e6bf155e0971","Type":"ContainerStarted","Data":"3f51caa120fc62a28f506b53cb6137fee4e114ac0808f997aa0e692a449b757f"} Sep 07 12:11:03.277331 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:03.277304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:03.467535 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:03.467503 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:03.668271 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:03.668242 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:03.859892 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:03.859862 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:03.978137 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:03.978110 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:04.078179 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.078148 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:04.262224 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.262145 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:04.750063 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.750020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:04.750244 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.750070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:11:04.750244 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.750110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:11:04.750244 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.750144 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:11:04.750244 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.750176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:04.750244 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.750223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:11:04.751032 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.750745 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-service-ca-bundle\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:04.753527 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.753180 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0e801c3-29d2-4551-afa1-cac8f60ab159-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-8tclq\" (UID: \"f0e801c3-29d2-4551-afa1-cac8f60ab159\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:11:04.753527 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.753483 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/edba9693-13c0-408d-b381-480e11ba4afb-metrics-tls\") pod \"dns-default-swgj9\" (UID: \"edba9693-13c0-408d-b381-480e11ba4afb\") " pod="openshift-dns/dns-default-swgj9" Sep 07 12:11:04.753718 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.753691 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f949622d-8482-4580-b561-903730060a47-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-2zpn8\" (UID: \"f949622d-8482-4580-b561-903730060a47\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:11:04.753826 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.753726 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"image-registry-647685dbb6-mhbw7\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:11:04.754476 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.754456 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e5dd72-77d2-40c3-94ea-f99bb3dc3387-metrics-certs\") pod \"router-default-68fb9cd898-bzvx4\" (UID: \"68e5dd72-77d2-40c3-94ea-f99bb3dc3387\") " pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:04.902888 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.902860 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dcrgp\"" Sep 07 12:11:04.911808 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.911779 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:11:04.930171 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.930017 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fsmff\"" Sep 07 12:11:04.938781 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.938760 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" Sep 07 12:11:04.942791 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.942770 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-948qh\"" Sep 07 12:11:04.951778 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.951706 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" Sep 07 12:11:04.980436 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.980402 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r57zq\"" Sep 07 12:11:04.988020 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.987991 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:04.997373 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:04.996169 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rwpcl\"" Sep 07 12:11:05.004403 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.004374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-swgj9" Sep 07 12:11:05.198478 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.198444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-647685dbb6-mhbw7"] Sep 07 12:11:05.231656 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.231639 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq"] Sep 07 12:11:05.265239 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.265166 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8"] Sep 07 12:11:05.277708 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.277636 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68fb9cd898-bzvx4"] Sep 07 12:11:05.309728 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.309705 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-swgj9"] Sep 07 12:11:05.541824 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:05.541742 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e801c3_29d2_4551_afa1_cac8f60ab159.slice/crio-223ff47e5f7014b14e292adc0bdfda68bb07c866c12b98b9a1b325640b7fa2f0 WatchSource:0}: Error finding container 223ff47e5f7014b14e292adc0bdfda68bb07c866c12b98b9a1b325640b7fa2f0: Status 404 returned error can't find the container with id 223ff47e5f7014b14e292adc0bdfda68bb07c866c12b98b9a1b325640b7fa2f0 Sep 07 12:11:05.542511 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:05.542425 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ccaa88_dcbe_4776_88a0_6b73e9931cdd.slice/crio-115153eda18af1e71ab4a3e5c65b48987c739ea0afd9fdccb884072b4f698927 WatchSource:0}: Error finding container 115153eda18af1e71ab4a3e5c65b48987c739ea0afd9fdccb884072b4f698927: Status 404 returned error can't find the container with id 115153eda18af1e71ab4a3e5c65b48987c739ea0afd9fdccb884072b4f698927 Sep 07 12:11:05.544182 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:05.544080 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e5dd72_77d2_40c3_94ea_f99bb3dc3387.slice/crio-03242cac461ddbaf18f625857fd58ae83950b6fb6f3e12590e70c804bbd546e2 WatchSource:0}: Error finding container 03242cac461ddbaf18f625857fd58ae83950b6fb6f3e12590e70c804bbd546e2: Status 404 returned error can't find the container with id 03242cac461ddbaf18f625857fd58ae83950b6fb6f3e12590e70c804bbd546e2 Sep 07 12:11:05.545134 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:05.545049 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedba9693_13c0_408d_b381_480e11ba4afb.slice/crio-1a04cb39e16d37c128e819a9f642efc7f61d7f0fa19d0cc94a763386678f884f WatchSource:0}: Error finding container 1a04cb39e16d37c128e819a9f642efc7f61d7f0fa19d0cc94a763386678f884f: Status 404 returned error can't find the container with id 1a04cb39e16d37c128e819a9f642efc7f61d7f0fa19d0cc94a763386678f884f Sep 07 12:11:05.861930 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.861898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:11:05.864361 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.864324 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/524bf8ca-1381-4b45-9dd4-c4b00152a215-metrics-certs\") pod \"network-metrics-daemon-7mjbg\" (UID: \"524bf8ca-1381-4b45-9dd4-c4b00152a215\") " pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:11:05.981183 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.981150 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6gzq2\"" Sep 07 12:11:05.990000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:05.989983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7mjbg" Sep 07 12:11:06.256343 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.256274 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7mjbg"] Sep 07 12:11:06.258996 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:06.258967 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524bf8ca_1381_4b45_9dd4_c4b00152a215.slice/crio-68667774b5fb4b82dfec3a295235768f06aec6bb50364040417e2b08411f1180 WatchSource:0}: Error finding container 68667774b5fb4b82dfec3a295235768f06aec6bb50364040417e2b08411f1180: Status 404 returned error can't find the container with id 68667774b5fb4b82dfec3a295235768f06aec6bb50364040417e2b08411f1180 Sep 07 12:11:06.267411 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.267385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mjbg" event={"ID":"524bf8ca-1381-4b45-9dd4-c4b00152a215","Type":"ContainerStarted","Data":"68667774b5fb4b82dfec3a295235768f06aec6bb50364040417e2b08411f1180"} Sep 07 12:11:06.268519 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.268493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" event={"ID":"f949622d-8482-4580-b561-903730060a47","Type":"ContainerStarted","Data":"60ae60b3e28cc226e683e93f75671d824ce9675f274ebc727074475543024abb"} Sep 07 12:11:06.270348 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.270328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmb5f" event={"ID":"87b0147c-1cfb-4c8b-869f-e6bf155e0971","Type":"ContainerStarted","Data":"b2f5ac484510efd915ff2c55a5f0ad8c690527711438e5e5befae039f90534b9"} Sep 07 12:11:06.271471 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.271451 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-swgj9" event={"ID":"edba9693-13c0-408d-b381-480e11ba4afb","Type":"ContainerStarted","Data":"1a04cb39e16d37c128e819a9f642efc7f61d7f0fa19d0cc94a763386678f884f"} Sep 07 12:11:06.272920 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.272899 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" event={"ID":"68e5dd72-77d2-40c3-94ea-f99bb3dc3387","Type":"ContainerStarted","Data":"70371ef1173c4d8975a9f484effe22bec2bcf939987494d0eb34b0dc1747fa92"} Sep 07 12:11:06.273053 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.272930 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" event={"ID":"68e5dd72-77d2-40c3-94ea-f99bb3dc3387","Type":"ContainerStarted","Data":"03242cac461ddbaf18f625857fd58ae83950b6fb6f3e12590e70c804bbd546e2"} Sep 07 12:11:06.274216 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.274194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" event={"ID":"f0e801c3-29d2-4551-afa1-cac8f60ab159","Type":"ContainerStarted","Data":"223ff47e5f7014b14e292adc0bdfda68bb07c866c12b98b9a1b325640b7fa2f0"} Sep 07 12:11:06.275494 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.275477 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" event={"ID":"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd","Type":"ContainerStarted","Data":"cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2"} Sep 07 12:11:06.275572 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.275505 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" event={"ID":"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd","Type":"ContainerStarted","Data":"115153eda18af1e71ab4a3e5c65b48987c739ea0afd9fdccb884072b4f698927"} Sep 07 12:11:06.275620 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.275572 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:11:06.286054 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.286013 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cmb5f" podStartSLOduration=17.329316894 podStartE2EDuration="21.286001038s" totalImagesPullingTime="3.956684144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:10:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:06.284967111 +0000 UTC m=+66.809383410" watchObservedRunningTime="2026-09-07 12:11:06.286001038 +0000 UTC m=+66.810417327" Sep 07 12:11:06.301248 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.301209 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" podStartSLOduration=66.30119241 podStartE2EDuration="1m6.30119241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:06.300088535 +0000 UTC m=+66.824504834" watchObservedRunningTime="2026-09-07 12:11:06.30119241 +0000 UTC m=+66.825608702" Sep 07 12:11:06.315596 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.315566 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" podStartSLOduration=57.3155554 podStartE2EDuration="57.3155554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:06.315029445 +0000 UTC m=+66.839445747" watchObservedRunningTime="2026-09-07 12:11:06.3155554 +0000 UTC m=+66.839971690" Sep 07 12:11:06.968826 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.968661 2577 scope.go:117] "RemoveContainer" containerID="37fadc9860a0572aea3a183a2e8e819eb21f7fc79d7c2b273a8f844f589dc7ae" Sep 07 12:11:06.972865 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.972289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:11:06.975576 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.975554 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2cf7c2d9-0396-4849-b25d-621ed1675bc7-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tj2gj\" (UID: \"2cf7c2d9-0396-4849-b25d-621ed1675bc7\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:11:06.988518 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.988489 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:06.995368 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:06.995347 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:07.114733 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:07.114524 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-d2lwf\"" Sep 07 12:11:07.123695 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:07.123425 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" Sep 07 12:11:07.282618 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:07.282554 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/1.log" Sep 07 12:11:07.283004 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:07.282740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" event={"ID":"3f6383ab-9e3a-44b1-aa58-06f0471b9cac","Type":"ContainerStarted","Data":"cc8ed16d2a41c2d9f0c1587fd30a3818b8446422ace91a46786bdbf2fdd7828e"} Sep 07 12:11:07.283435 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:07.283417 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:07.284286 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:07.284265 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68fb9cd898-bzvx4" Sep 07 12:11:07.318418 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:07.318346 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" podStartSLOduration=47.634206868 podStartE2EDuration="58.31832855s" totalImagesPullingTime="10.684121682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:07.30081236 +0000 UTC m=+67.825228665" watchObservedRunningTime="2026-09-07 12:11:07.31832855 +0000 UTC m=+67.842744839" Sep 07 12:11:08.453817 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:08.453782 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:08.561115 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:08.561064 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:08.656405 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:08.656356 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:08.747456 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:08.747391 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tj2gj"] Sep 07 12:11:08.766866 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:08.766787 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:08.863026 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:08.862902 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:08.969309 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:08.969168 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:09.076504 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.076472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:09.176101 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.176067 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:09.300102 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.299990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mjbg" event={"ID":"524bf8ca-1381-4b45-9dd4-c4b00152a215","Type":"ContainerStarted","Data":"08fcf45a4210a98315d30f8bc3c7f9597140e38b9e1ef3dcf4475424419955fb"} Sep 07 12:11:09.300401 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.300349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7mjbg" event={"ID":"524bf8ca-1381-4b45-9dd4-c4b00152a215","Type":"ContainerStarted","Data":"9df4cf50eabfc3a518cf8e279e955e92d609df22b61774d502fd35bec273d86a"} Sep 07 12:11:09.301501 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.301468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" event={"ID":"2cf7c2d9-0396-4849-b25d-621ed1675bc7","Type":"ContainerStarted","Data":"f453476ca750c944dab96ef810b4fb8131c789a193ca41887555a1f75256fc39"} Sep 07 12:11:09.303766 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.303748 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-swgj9" event={"ID":"edba9693-13c0-408d-b381-480e11ba4afb","Type":"ContainerStarted","Data":"64a8393418ccb3cf74287847d25be0f3efbd37b771b165ee0bb786cfaebfcd51"} Sep 07 12:11:09.303876 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.303782 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-swgj9" event={"ID":"edba9693-13c0-408d-b381-480e11ba4afb","Type":"ContainerStarted","Data":"a6cb0632da02f0ad2476b7e074b23931cd3b6f5ad4b41d4084b74e0b14c25fd5"} Sep 07 12:11:09.303939 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.303876 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-swgj9" Sep 07 12:11:09.309100 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.309031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" event={"ID":"f0e801c3-29d2-4551-afa1-cac8f60ab159","Type":"ContainerStarted","Data":"ba6b680e9796c7c38028667ae0ce41fa7bfd0ad211fb11dd8ba46f441efccd21"} Sep 07 12:11:09.321128 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.321087 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7mjbg" podStartSLOduration=67.116215839 podStartE2EDuration="1m9.321074879s" totalImagesPullingTime="2.20485904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:09.319567707 +0000 UTC m=+69.843983997" watchObservedRunningTime="2026-09-07 12:11:09.321074879 +0000 UTC m=+69.845491169" Sep 07 12:11:09.335590 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.335554 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-8tclq" podStartSLOduration=57.408511281 podStartE2EDuration="1m0.335541024s" totalImagesPullingTime="2.927029743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:09.335069724 +0000 UTC m=+69.859486017" watchObservedRunningTime="2026-09-07 12:11:09.335541024 +0000 UTC m=+69.859957314" Sep 07 12:11:09.352989 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:09.352936 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-swgj9" podStartSLOduration=34.432110092 podStartE2EDuration="37.352923645s" totalImagesPullingTime="2.920813553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:09.352344829 +0000 UTC m=+69.876761137" watchObservedRunningTime="2026-09-07 12:11:09.352923645 +0000 UTC m=+69.877339934" Sep 07 12:11:10.019379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:10.019309 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:10.122546 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:10.122515 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:10.220269 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:10.220234 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:10.314997 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:10.314896 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" event={"ID":"f949622d-8482-4580-b561-903730060a47","Type":"ContainerStarted","Data":"6511bd248ea853074c20b6e58f19d2f673260df8d5690f8f21fd0a26b00403da"} Sep 07 12:11:10.315137 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:10.315013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" event={"ID":"f949622d-8482-4580-b561-903730060a47","Type":"ContainerStarted","Data":"0178a87f4a098d91111c5e2a7227151d040fc89ef623a47bf24cdb8202a977dc"} Sep 07 12:11:10.331621 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:10.331571 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-2zpn8" podStartSLOduration=57.158804416 podStartE2EDuration="1m1.331556654s" totalImagesPullingTime="4.172752238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:10.330669524 +0000 UTC m=+70.855085834" watchObservedRunningTime="2026-09-07 12:11:10.331556654 +0000 UTC m=+70.855972964" Sep 07 12:11:10.556812 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:10.556764 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:10.606149 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:10.606112 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:11.012155 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:11.012070 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:11.065074 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:11.065041 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:11.353974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:11.353930 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:11.452794 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:11.452766 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:11.755110 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:11.755026 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:11.855644 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:11.855611 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:12.323693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:12.323659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" event={"ID":"2cf7c2d9-0396-4849-b25d-621ed1675bc7","Type":"ContainerStarted","Data":"41b9da1e629af11e83f66b071383e403122a05dfb1d80d66cdbd5bf9c86a256f"} Sep 07 12:11:12.340403 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:12.340357 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-tj2gj" podStartSLOduration=35.701438401 podStartE2EDuration="38.34034222s" totalImagesPullingTime="2.638903819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:12.339406839 +0000 UTC m=+72.863823132" watchObservedRunningTime="2026-09-07 12:11:12.34034222 +0000 UTC m=+72.864758510" Sep 07 12:11:12.561711 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:12.561672 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:12.953300 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:12.953263 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:13.004594 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:13.004559 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:14.994090 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:14.994049 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:15.078567 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:15.078527 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:16.035005 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:16.034968 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:16.686118 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:16.686085 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:16.734163 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:16.734130 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:17.203608 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:17.203582 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gxclc" Sep 07 12:11:17.283614 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:17.283590 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:11:17.287259 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:17.287239 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-xk7vd" Sep 07 12:11:18.980020 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:18.979990 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:19.082881 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:19.082849 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:19.183001 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:19.182969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:19.317294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:19.317234 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-swgj9" Sep 07 12:11:19.680500 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:19.680463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:21.167873 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.167742 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:21.370471 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.370437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:21.456516 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.456424 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8"] Sep 07 12:11:21.460187 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.460165 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.463764 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.463744 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 07 12:11:21.463764 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.463762 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vkwqp\"" Sep 07 12:11:21.463918 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.463747 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 07 12:11:21.463918 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.463752 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 12:11:21.466690 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.466673 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv"] Sep 07 12:11:21.469247 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.469228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.473774 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.473601 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 07 12:11:21.474167 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.474148 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 07 12:11:21.474308 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.474278 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 07 12:11:21.474408 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.474244 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qv2sn\"" Sep 07 12:11:21.474767 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.474747 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8"] Sep 07 12:11:21.480966 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.480928 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2wm26"] Sep 07 12:11:21.483584 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.483560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.484925 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.484905 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv"] Sep 07 12:11:21.486354 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.486213 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 12:11:21.487369 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.487348 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 12:11:21.487607 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.487592 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 12:11:21.487801 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.487787 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rprlb\"" Sep 07 12:11:21.494679 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.494656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:21.590612 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm9pd\" (UniqueName: \"kubernetes.io/projected/13e04c77-e4b9-4117-a0ea-4184cf84312c-kube-api-access-zm9pd\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.590784 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-textfile\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.590784 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.590784 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590672 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.590784 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-wtmp\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.590784 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ababad5-a76f-4d52-970d-f063e0aea7d1-metrics-client-ca\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.590996 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590805 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13e04c77-e4b9-4117-a0ea-4184cf84312c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.590996 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.590996 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590858 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e04c77-e4b9-4117-a0ea-4184cf84312c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.590996 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.590996 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.590996 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.590996 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-root\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.591201 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.590997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13e04c77-e4b9-4117-a0ea-4184cf84312c-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.591201 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.591038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqzvq\" (UniqueName: \"kubernetes.io/projected/2ababad5-a76f-4d52-970d-f063e0aea7d1-kube-api-access-pqzvq\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.591201 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.591055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-tls\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.591201 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.591073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mn97\" (UniqueName: \"kubernetes.io/projected/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-api-access-9mn97\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.591201 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.591096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.591201 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.591132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-sys\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.614338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.614304 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:21.692467 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-tls\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.692616 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692473 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mn97\" (UniqueName: \"kubernetes.io/projected/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-api-access-9mn97\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.692616 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.692687 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-sys\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.692687 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm9pd\" (UniqueName: \"kubernetes.io/projected/13e04c77-e4b9-4117-a0ea-4184cf84312c-kube-api-access-zm9pd\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.692787 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-textfile\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.692787 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692727 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.692787 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692740 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-sys\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.692787 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692753 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.692787 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-wtmp\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ababad5-a76f-4d52-970d-f063e0aea7d1-metrics-client-ca\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13e04c77-e4b9-4117-a0ea-4184cf84312c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e04c77-e4b9-4117-a0ea-4184cf84312c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:11:21.692911 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.692935 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:11:21.693003 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-tls podName:c6061a7f-eea8-4a41-aec0-d8fb6650c98f nodeName:}" failed. No retries permitted until 2026-09-07 12:11:22.192982728 +0000 UTC m=+82.717399001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-7kmvv" (UID: "c6061a7f-eea8-4a41-aec0-d8fb6650c98f") : secret "kube-state-metrics-tls" not found Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.693062 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693051 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.693565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-root\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.693565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693073 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.693565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13e04c77-e4b9-4117-a0ea-4184cf84312c-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.693565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqzvq\" (UniqueName: \"kubernetes.io/projected/2ababad5-a76f-4d52-970d-f063e0aea7d1-kube-api-access-pqzvq\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.693565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693221 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-wtmp\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.693565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.693565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ababad5-a76f-4d52-970d-f063e0aea7d1-root\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.693565 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693469 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ababad5-a76f-4d52-970d-f063e0aea7d1-metrics-client-ca\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.694011 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693580 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.694011 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693764 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.694011 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.693921 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-textfile\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.694364 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.694130 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13e04c77-e4b9-4117-a0ea-4184cf84312c-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.695346 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.695326 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-tls\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.696104 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.696076 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13e04c77-e4b9-4117-a0ea-4184cf84312c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.696253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.696234 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13e04c77-e4b9-4117-a0ea-4184cf84312c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.696315 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.696300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ababad5-a76f-4d52-970d-f063e0aea7d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.696371 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.696355 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.702113 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.702079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm9pd\" (UniqueName: \"kubernetes.io/projected/13e04c77-e4b9-4117-a0ea-4184cf84312c-kube-api-access-zm9pd\") pod \"openshift-state-metrics-657fd6c54-42xh8\" (UID: \"13e04c77-e4b9-4117-a0ea-4184cf84312c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.702211 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.702091 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mn97\" (UniqueName: \"kubernetes.io/projected/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-api-access-9mn97\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:21.703699 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.703680 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqzvq\" (UniqueName: \"kubernetes.io/projected/2ababad5-a76f-4d52-970d-f063e0aea7d1-kube-api-access-pqzvq\") pod \"node-exporter-2wm26\" (UID: \"2ababad5-a76f-4d52-970d-f063e0aea7d1\") " pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.715772 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.715719 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:21.770211 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.770175 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" Sep 07 12:11:21.794224 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.794184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wm26" Sep 07 12:11:21.805123 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:21.805100 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ababad5_a76f_4d52_970d_f063e0aea7d1.slice/crio-457450e92a46c55c71805f31347bd8263f359694ff3fe5bfa6571d1580074f25 WatchSource:0}: Error finding container 457450e92a46c55c71805f31347bd8263f359694ff3fe5bfa6571d1580074f25: Status 404 returned error can't find the container with id 457450e92a46c55c71805f31347bd8263f359694ff3fe5bfa6571d1580074f25 Sep 07 12:11:21.815282 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.815257 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:21.914672 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:21.914645 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:22.014488 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.014403 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:22.040595 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.040574 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8"] Sep 07 12:11:22.042736 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:22.042709 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e04c77_e4b9_4117_a0ea_4184cf84312c.slice/crio-28926f9f393ab253333757f24e7e0896c73c14737f9665281b717723847a3724 WatchSource:0}: Error finding container 28926f9f393ab253333757f24e7e0896c73c14737f9665281b717723847a3724: Status 404 returned error can't find the container with id 28926f9f393ab253333757f24e7e0896c73c14737f9665281b717723847a3724 Sep 07 12:11:22.115047 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.115023 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:22.197280 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.197246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:22.199633 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.199614 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6061a7f-eea8-4a41-aec0-d8fb6650c98f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-7kmvv\" (UID: \"c6061a7f-eea8-4a41-aec0-d8fb6650c98f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:22.361604 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.361565 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wm26" event={"ID":"2ababad5-a76f-4d52-970d-f063e0aea7d1","Type":"ContainerStarted","Data":"457450e92a46c55c71805f31347bd8263f359694ff3fe5bfa6571d1580074f25"} Sep 07 12:11:22.364077 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.364050 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" event={"ID":"13e04c77-e4b9-4117-a0ea-4184cf84312c","Type":"ContainerStarted","Data":"f7e6e0f94f8750a9ce7eff513f812b1168ebcf57bae667dc2591cd91f8d02c75"} Sep 07 12:11:22.364210 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.364099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" event={"ID":"13e04c77-e4b9-4117-a0ea-4184cf84312c","Type":"ContainerStarted","Data":"dadf9cdfb35f5972b8d60da1d520be1b8c64ea1facd054f0a5632679f14b7a61"} Sep 07 12:11:22.364210 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.364118 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" event={"ID":"13e04c77-e4b9-4117-a0ea-4184cf84312c","Type":"ContainerStarted","Data":"28926f9f393ab253333757f24e7e0896c73c14737f9665281b717723847a3724"} Sep 07 12:11:22.378148 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.378125 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" Sep 07 12:11:22.398999 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.398971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:22.474314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.474283 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:22.475484 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.475350 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:11:22.479140 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.479121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.481387 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.481363 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 12:11:22.481555 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.481468 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 12:11:22.481555 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.481474 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hrdch\"" Sep 07 12:11:22.481691 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.481663 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 12:11:22.481785 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.481767 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 12:11:22.481835 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.481812 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 12:11:22.481897 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.481881 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 12:11:22.482079 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.482064 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 12:11:22.482128 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.482105 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 12:11:22.482128 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.482068 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 12:11:22.495567 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.495549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:11:22.599865 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.599834 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62f4g\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-kube-api-access-62f4g\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600033 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.599877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600033 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.599931 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600033 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600179 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600049 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-web-config\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600179 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-config-volume\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600179 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-config-out\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600179 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600179 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600419 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600419 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600419 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.600419 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.600392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.653354 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.653249 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv"] Sep 07 12:11:22.655803 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:22.655783 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6061a7f_eea8_4a41_aec0_d8fb6650c98f.slice/crio-071bad64327c886dd87deb4915ab1fd65cacd47d2af4494da7711095fcffba1b WatchSource:0}: Error finding container 071bad64327c886dd87deb4915ab1fd65cacd47d2af4494da7711095fcffba1b: Status 404 returned error can't find the container with id 071bad64327c886dd87deb4915ab1fd65cacd47d2af4494da7711095fcffba1b Sep 07 12:11:22.701148 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701246 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701165 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-web-config\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701246 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-config-volume\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701246 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-config-out\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701396 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701396 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701396 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701396 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701523 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701523 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701523 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62f4g\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-kube-api-access-62f4g\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701647 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.701701 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.701646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.702393 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.702327 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.703028 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:11:22.703005 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 07 12:11:22.703125 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:11:22.703088 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls podName:572509e8-05d5-438a-aac0-c14360097a14 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:23.203065598 +0000 UTC m=+83.727481869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "572509e8-05d5-438a-aac0-c14360097a14") : secret "alertmanager-main-tls" not found Sep 07 12:11:22.703125 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.703102 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.703431 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.703404 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.706058 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.706017 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-config-volume\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.707476 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.707448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-tls-assets\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.707566 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.707469 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.707676 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.707650 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.707923 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.707895 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.708619 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.708600 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-web-config\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.708888 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.708869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.709236 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.709218 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-config-out\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:22.712328 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:22.712306 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62f4g\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-kube-api-access-62f4g\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:23.069584 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.069553 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:23.170393 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.170360 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:23.205338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.205314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:23.207522 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.207506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:23.272218 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.272186 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:23.369488 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.369456 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" event={"ID":"c6061a7f-eea8-4a41-aec0-d8fb6650c98f","Type":"ContainerStarted","Data":"071bad64327c886dd87deb4915ab1fd65cacd47d2af4494da7711095fcffba1b"} Sep 07 12:11:23.371047 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.371019 2577 generic.go:356] "Generic (PLEG): container finished" podID="2ababad5-a76f-4d52-970d-f063e0aea7d1" containerID="36cc9c98a5e0d75da1173255e4bb28ed3cb8460d787330ac8e83c271b0e772e2" exitCode=0 Sep 07 12:11:23.371201 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.371057 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wm26" event={"ID":"2ababad5-a76f-4d52-970d-f063e0aea7d1","Type":"ContainerDied","Data":"36cc9c98a5e0d75da1173255e4bb28ed3cb8460d787330ac8e83c271b0e772e2"} Sep 07 12:11:23.388076 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.388057 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:11:23.458493 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.458351 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:23.519861 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.519832 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:23.620589 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.620497 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:23.673175 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:23.673146 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:11:23.979613 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:23.979544 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572509e8_05d5_438a_aac0_c14360097a14.slice/crio-3c656cc91f124b747a753b62fda8267c822fa9f6cdc8d75799bffe1591c4a389 WatchSource:0}: Error finding container 3c656cc91f124b747a753b62fda8267c822fa9f6cdc8d75799bffe1591c4a389: Status 404 returned error can't find the container with id 3c656cc91f124b747a753b62fda8267c822fa9f6cdc8d75799bffe1591c4a389 Sep 07 12:11:24.322798 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.322766 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:24.377762 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.377726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wm26" event={"ID":"2ababad5-a76f-4d52-970d-f063e0aea7d1","Type":"ContainerStarted","Data":"9d414cc3d90b133d3f4bf03da7a45a58f7ae1e046f64c878130bea7962348cac"} Sep 07 12:11:24.377935 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.377791 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wm26" event={"ID":"2ababad5-a76f-4d52-970d-f063e0aea7d1","Type":"ContainerStarted","Data":"d2f54c99d4ec5c3672e64a76c9368288a259d42d2cdb915a6bc66ee909682731"} Sep 07 12:11:24.380119 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.380079 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" event={"ID":"c6061a7f-eea8-4a41-aec0-d8fb6650c98f","Type":"ContainerStarted","Data":"7c0008fbb63efec36548682828a58cd772de46e17da394d231ee8fdd146a64dc"} Sep 07 12:11:24.380256 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.380134 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" event={"ID":"c6061a7f-eea8-4a41-aec0-d8fb6650c98f","Type":"ContainerStarted","Data":"e5ecdeff3953f9b05e1384eae5a930decb53d03f31a311f859384c433ce84e05"} Sep 07 12:11:24.380256 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.380163 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" event={"ID":"c6061a7f-eea8-4a41-aec0-d8fb6650c98f","Type":"ContainerStarted","Data":"daf0b83cb4bd60598842396a84747d0041e027f0fad82e49ffa2fc2551ddacae"} Sep 07 12:11:24.381318 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.381292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerStarted","Data":"3c656cc91f124b747a753b62fda8267c822fa9f6cdc8d75799bffe1591c4a389"} Sep 07 12:11:24.394060 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.394018 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2wm26" podStartSLOduration=2.077793469 podStartE2EDuration="3.394002302s" totalImagesPullingTime="1.247220591s" totalInitContainerRuntime="68.988242ms" isStatefulPod=true podCreationTimestamp="2026-09-07 12:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:24.393345473 +0000 UTC m=+84.917761762" watchObservedRunningTime="2026-09-07 12:11:24.394002302 +0000 UTC m=+84.918418593" Sep 07 12:11:24.397967 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.397932 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:24.411385 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.411337 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-7kmvv" podStartSLOduration=2.040587717 podStartE2EDuration="3.41131903s" totalImagesPullingTime="1.370731313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:24.410455955 +0000 UTC m=+84.934872274" watchObservedRunningTime="2026-09-07 12:11:24.41131903 +0000 UTC m=+84.935735322" Sep 07 12:11:24.639563 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.639530 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:24.841931 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:24.841894 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:25.387602 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:25.387563 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" event={"ID":"13e04c77-e4b9-4117-a0ea-4184cf84312c","Type":"ContainerStarted","Data":"bf9d65b890037fad50bec2d0b87ba517f32378bb1b81fb8cf06f28f2d6b2098c"} Sep 07 12:11:25.389218 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:25.389194 2577 generic.go:356] "Generic (PLEG): container finished" podID="572509e8-05d5-438a-aac0-c14360097a14" containerID="b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e" exitCode=0 Sep 07 12:11:25.389329 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:25.389279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerDied","Data":"b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e"} Sep 07 12:11:25.403391 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:25.403342 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-42xh8" podStartSLOduration=1.382149949 podStartE2EDuration="4.403329026s" totalImagesPullingTime="3.021179077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:11:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:25.402736468 +0000 UTC m=+85.927152778" watchObservedRunningTime="2026-09-07 12:11:25.403329026 +0000 UTC m=+85.927745315" Sep 07 12:11:25.957437 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:25.957379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:26.201393 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.201364 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297"] Sep 07 12:11:26.204245 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.204215 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:26.204692 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.204677 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:26.207059 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.207036 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 07 12:11:26.207059 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.207049 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sqv2f\"" Sep 07 12:11:26.212559 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.212536 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297"] Sep 07 12:11:26.235372 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.235343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wtzs\" (UniqueName: \"kubernetes.io/projected/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-kube-api-access-2wtzs\") pod \"monitoring-plugin-85bbbbbf4-6c297\" (UID: \"fd0dff7a-b736-404d-b9d9-e8cd1d164f76\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:26.235487 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.235432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6c297\" (UID: \"fd0dff7a-b736-404d-b9d9-e8cd1d164f76\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:26.264912 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.264886 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:26.336055 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.336028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6c297\" (UID: \"fd0dff7a-b736-404d-b9d9-e8cd1d164f76\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:26.336170 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.336074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wtzs\" (UniqueName: \"kubernetes.io/projected/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-kube-api-access-2wtzs\") pod \"monitoring-plugin-85bbbbbf4-6c297\" (UID: \"fd0dff7a-b736-404d-b9d9-e8cd1d164f76\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:26.336215 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:11:26.336176 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 07 12:11:26.336254 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:11:26.336239 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-monitoring-plugin-cert podName:fd0dff7a-b736-404d-b9d9-e8cd1d164f76 nodeName:}" failed. No retries permitted until 2026-09-07 12:11:26.836220426 +0000 UTC m=+87.360636694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-6c297" (UID: "fd0dff7a-b736-404d-b9d9-e8cd1d164f76") : secret "monitoring-plugin-cert" not found Sep 07 12:11:26.344173 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.344151 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wtzs\" (UniqueName: \"kubernetes.io/projected/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-kube-api-access-2wtzs\") pod \"monitoring-plugin-85bbbbbf4-6c297\" (UID: \"fd0dff7a-b736-404d-b9d9-e8cd1d164f76\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:26.620512 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.620483 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:26.841614 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.841581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6c297\" (UID: \"fd0dff7a-b736-404d-b9d9-e8cd1d164f76\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:26.844196 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:26.844173 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd0dff7a-b736-404d-b9d9-e8cd1d164f76-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-6c297\" (UID: \"fd0dff7a-b736-404d-b9d9-e8cd1d164f76\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:27.113686 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.113650 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:27.287896 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.287868 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:11:27.403906 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.403880 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297"] Sep 07 12:11:27.576175 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.576127 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:27.580378 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.580355 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:11:27.585492 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.585473 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.588066 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588043 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 12:11:27.588066 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588048 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 12:11:27.588236 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588048 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 12:11:27.588334 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588316 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 12:11:27.588448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588348 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 12:11:27.588615 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588589 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-213e96g7gk7q7\"" Sep 07 12:11:27.588615 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588598 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 12:11:27.588749 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588618 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 12:11:27.588806 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.588769 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 12:11:27.589339 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.589319 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bfhxw\"" Sep 07 12:11:27.590093 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.589486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 12:11:27.590093 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.589581 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 12:11:27.590093 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.589613 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 12:11:27.590093 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.589624 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 12:11:27.590093 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.589706 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 12:11:27.590093 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.589852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 12:11:27.591561 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.591542 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 12:11:27.602779 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.602757 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:11:27.652160 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652134 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82dcp\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-kube-api-access-82dcp\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config-out\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652246 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652395 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652439 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652552 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-web-config\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652636 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652660 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652786 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.652974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.652815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.712831 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:27.712773 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0dff7a_b736_404d_b9d9_e8cd1d164f76.slice/crio-7d434c58493159077fed014da9d3c55063167f00287baca56f112793e05ea1b4 WatchSource:0}: Error finding container 7d434c58493159077fed014da9d3c55063167f00287baca56f112793e05ea1b4: Status 404 returned error can't find the container with id 7d434c58493159077fed014da9d3c55063167f00287baca56f112793e05ea1b4 Sep 07 12:11:27.728971 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.728916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:27.754142 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754227 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754227 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754227 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754227 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754416 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-web-config\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754458 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754501 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754557 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754557 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754651 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754651 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754651 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754797 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754797 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754712 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754797 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754797 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82dcp\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-kube-api-access-82dcp\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.754797 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config-out\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.755071 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.755071 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.755071 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.754974 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.755220 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.755139 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.755874 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.755584 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.755874 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.755762 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.756052 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.755877 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.756716 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.756399 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.756716 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.756494 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.757490 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.757418 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.760697 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.759674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.760697 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.759858 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.760697 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.760091 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.760697 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.760525 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.760697 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.760536 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-web-config\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.760937 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.760818 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config-out\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.761176 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.760675 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.761356 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.761323 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.761485 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.761460 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.761601 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.761500 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.762816 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.762796 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.763672 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.763646 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82dcp\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-kube-api-access-82dcp\") pod \"prometheus-k8s-0\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:27.896674 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:27.896636 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:28.185639 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.185616 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:11:28.186824 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:11:28.186801 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14d4bdc_bf7f_408c_8b0a_55bd8eda738f.slice/crio-e2e742b4bb74dec1831ca9b51e1c92f56b354e0fd1257bc8b562f9d50100a02a WatchSource:0}: Error finding container e2e742b4bb74dec1831ca9b51e1c92f56b354e0fd1257bc8b562f9d50100a02a: Status 404 returned error can't find the container with id e2e742b4bb74dec1831ca9b51e1c92f56b354e0fd1257bc8b562f9d50100a02a Sep 07 12:11:28.404905 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.404869 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerStarted","Data":"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c"} Sep 07 12:11:28.405061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.404960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerStarted","Data":"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0"} Sep 07 12:11:28.405061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.404995 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerStarted","Data":"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf"} Sep 07 12:11:28.405061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.405027 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerStarted","Data":"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283"} Sep 07 12:11:28.405061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.405051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerStarted","Data":"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526"} Sep 07 12:11:28.406125 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.406103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" event={"ID":"fd0dff7a-b736-404d-b9d9-e8cd1d164f76","Type":"ContainerStarted","Data":"7d434c58493159077fed014da9d3c55063167f00287baca56f112793e05ea1b4"} Sep 07 12:11:28.407548 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.407530 2577 generic.go:356] "Generic (PLEG): container finished" podID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerID="6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129" exitCode=0 Sep 07 12:11:28.407633 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.407561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerDied","Data":"6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129"} Sep 07 12:11:28.407633 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:28.407611 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerStarted","Data":"e2e742b4bb74dec1831ca9b51e1c92f56b354e0fd1257bc8b562f9d50100a02a"} Sep 07 12:11:30.424164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:30.424065 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerStarted","Data":"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68"} Sep 07 12:11:30.429042 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:30.429005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" event={"ID":"fd0dff7a-b736-404d-b9d9-e8cd1d164f76","Type":"ContainerStarted","Data":"3d3d6b548b6f98d32af9666d6c869e049697249975667e1882c601ce72262d32"} Sep 07 12:11:30.429785 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:30.429726 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:30.435337 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:30.435317 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" Sep 07 12:11:30.449202 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:30.449159 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.795799688 podStartE2EDuration="8.44914126s" totalImagesPullingTime="5.63960476s" totalInitContainerRuntime="13.736812ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:11:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:30.448046597 +0000 UTC m=+90.972462898" watchObservedRunningTime="2026-09-07 12:11:30.44914126 +0000 UTC m=+90.973557551" Sep 07 12:11:30.467838 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:30.467684 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-6c297" podStartSLOduration=2.018120227 podStartE2EDuration="4.467665917s" totalImagesPullingTime="2.44954569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:30.466920881 +0000 UTC m=+90.991337172" watchObservedRunningTime="2026-09-07 12:11:30.467665917 +0000 UTC m=+90.992082208" Sep 07 12:11:30.984680 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:30.984554 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:31.027632 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:31.027601 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-647685dbb6-mhbw7"] Sep 07 12:11:31.117489 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:31.117454 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:31.167162 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:31.167125 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:31.220550 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:31.220513 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:33.198056 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:33.198017 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:33.298216 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:33.298193 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:33.444836 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:33.444808 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerStarted","Data":"3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f"} Sep 07 12:11:33.445001 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:33.444866 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerStarted","Data":"224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4"} Sep 07 12:11:33.978024 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:33.977988 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:34.025300 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:34.025265 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:35.011127 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:35.011099 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:35.110769 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:35.110720 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:35.457578 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:35.457474 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerStarted","Data":"c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746"} Sep 07 12:11:35.457578 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:35.457567 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerStarted","Data":"815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5"} Sep 07 12:11:35.457819 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:35.457608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerStarted","Data":"15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257"} Sep 07 12:11:35.457819 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:35.457648 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerStarted","Data":"752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249"} Sep 07 12:11:35.485381 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:35.485324 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.06940915 podStartE2EDuration="8.485305531s" totalImagesPullingTime="6.396207607s" totalInitContainerRuntime="19.688774ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:11:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:11:35.482016305 +0000 UTC m=+96.006432606" watchObservedRunningTime="2026-09-07 12:11:35.485305531 +0000 UTC m=+96.009721823" Sep 07 12:11:37.139598 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:37.139552 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:37.236260 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:37.236222 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:37.897650 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:37.897617 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:11:38.213053 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:38.212965 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:38.313021 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:38.312989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:38.413078 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:38.413046 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:42.244335 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:42.244297 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:42.295308 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:42.295276 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:44.253085 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:44.253045 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:44.308923 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:44.308891 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:44.372504 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:44.372474 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:48.991078 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:48.991033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:49.054431 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:49.054397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:11:56.055873 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.055834 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" podUID="c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" containerName="registry" containerID="cri-o://cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2" gracePeriod=30 Sep 07 12:11:56.302247 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.302223 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:11:56.319427 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319373 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-ca-trust-extracted\") pod \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " Sep 07 12:11:56.319427 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319411 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-installation-pull-secrets\") pod \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " Sep 07 12:11:56.319572 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319451 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-275ch\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-kube-api-access-275ch\") pod \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " Sep 07 12:11:56.319572 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319489 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-certificates\") pod \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " Sep 07 12:11:56.319572 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319515 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-trusted-ca\") pod \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " Sep 07 12:11:56.319572 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319553 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") pod \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " Sep 07 12:11:56.319764 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319585 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-bound-sa-token\") pod \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " Sep 07 12:11:56.319764 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319647 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-image-registry-private-configuration\") pod \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\" (UID: \"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd\") " Sep 07 12:11:56.320399 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.319968 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:11:56.320399 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.320333 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:11:56.323671 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.323619 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:11:56.323778 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.323748 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:11:56.323885 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.323860 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:11:56.323988 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.323963 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:11:56.324215 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.324175 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-kube-api-access-275ch" (OuterVolumeSpecName: "kube-api-access-275ch") pod "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd"). InnerVolumeSpecName "kube-api-access-275ch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:11:56.332606 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.332579 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" (UID: "c1ccaa88-dcbe-4776-88a0-6b73e9931cdd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:11:56.421164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.421120 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:11:56.421164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.421159 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-bound-sa-token\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:11:56.421164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.421169 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-image-registry-private-configuration\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:11:56.421164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.421180 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-ca-trust-extracted\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:11:56.421424 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.421190 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-installation-pull-secrets\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:11:56.421424 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.421198 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-275ch\" (UniqueName: \"kubernetes.io/projected/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-kube-api-access-275ch\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:11:56.421424 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.421206 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-registry-certificates\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:11:56.421424 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.421213 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd-trusted-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:11:56.544019 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.543985 2577 generic.go:356] "Generic (PLEG): container finished" podID="c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" containerID="cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2" exitCode=0 Sep 07 12:11:56.544198 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.544038 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" Sep 07 12:11:56.544198 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.544100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" event={"ID":"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd","Type":"ContainerDied","Data":"cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2"} Sep 07 12:11:56.544198 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.544133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647685dbb6-mhbw7" event={"ID":"c1ccaa88-dcbe-4776-88a0-6b73e9931cdd","Type":"ContainerDied","Data":"115153eda18af1e71ab4a3e5c65b48987c739ea0afd9fdccb884072b4f698927"} Sep 07 12:11:56.544198 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.544154 2577 scope.go:117] "RemoveContainer" containerID="cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2" Sep 07 12:11:56.553778 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.553760 2577 scope.go:117] "RemoveContainer" containerID="cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2" Sep 07 12:11:56.554071 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:11:56.554052 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2\": container with ID starting with cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2 not found: ID does not exist" containerID="cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2" Sep 07 12:11:56.554124 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.554080 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2"} err="failed to get container status \"cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2\": rpc error: code = NotFound desc = could not find container \"cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2\": container with ID starting with cda02df986cd4fe20c69b123fe3eb777341dd5310b1a2579fe5d37ce9070b7c2 not found: ID does not exist" Sep 07 12:11:56.564607 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.564587 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-647685dbb6-mhbw7"] Sep 07 12:11:56.568157 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:56.568137 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-647685dbb6-mhbw7"] Sep 07 12:11:57.972694 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:11:57.972662 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" path="/var/lib/kubelet/pods/c1ccaa88-dcbe-4776-88a0-6b73e9931cdd/volumes" Sep 07 12:12:02.880097 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:02.880057 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:03.636209 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:03.636169 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:03.977104 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:03.977010 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:04.077583 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:04.077537 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:05.586512 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:05.586477 2577 generic.go:356] "Generic (PLEG): container finished" podID="95e7ce93-4012-4f95-8c8f-f0949b031ca9" containerID="c7dd5b3a544cc02ac37027191e62fcbc16f164dfa136667613933f51dd522b0d" exitCode=0 Sep 07 12:12:05.586870 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:05.586551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" event={"ID":"95e7ce93-4012-4f95-8c8f-f0949b031ca9","Type":"ContainerDied","Data":"c7dd5b3a544cc02ac37027191e62fcbc16f164dfa136667613933f51dd522b0d"} Sep 07 12:12:05.586870 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:05.586860 2577 scope.go:117] "RemoveContainer" containerID="c7dd5b3a544cc02ac37027191e62fcbc16f164dfa136667613933f51dd522b0d" Sep 07 12:12:06.592391 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:06.592362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dmq2j" event={"ID":"95e7ce93-4012-4f95-8c8f-f0949b031ca9","Type":"ContainerStarted","Data":"4342475a6786c10b7da199f33313a0da74bdee1afb0368174fd9a609afb6e472"} Sep 07 12:12:10.610141 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:10.610105 2577 generic.go:356] "Generic (PLEG): container finished" podID="2c27082b-d48c-45e2-8e89-b2e437457038" containerID="5980775f39855df00a8514e31da5896b6e2dd6d995c1095565d0c1edb3e79904" exitCode=0 Sep 07 12:12:10.610562 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:10.610161 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" event={"ID":"2c27082b-d48c-45e2-8e89-b2e437457038","Type":"ContainerDied","Data":"5980775f39855df00a8514e31da5896b6e2dd6d995c1095565d0c1edb3e79904"} Sep 07 12:12:10.610562 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:10.610421 2577 scope.go:117] "RemoveContainer" containerID="5980775f39855df00a8514e31da5896b6e2dd6d995c1095565d0c1edb3e79904" Sep 07 12:12:11.616580 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:11.616546 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-rsfhf" event={"ID":"2c27082b-d48c-45e2-8e89-b2e437457038","Type":"ContainerStarted","Data":"294fefcd13bd48d7903e1588aa872e4f1e93833f21e5c6035809edbbfd597c54"} Sep 07 12:12:15.397746 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:15.397711 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:15.445013 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:15.444981 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:19.649382 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:19.649350 2577 generic.go:356] "Generic (PLEG): container finished" podID="7795859b-24f2-497c-ad22-f6f64ee052b1" containerID="6f594d9c8431fa6c437192d7e854122f0e3235acfd94255d2b74719a05e25e18" exitCode=0 Sep 07 12:12:19.649669 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:19.649419 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" event={"ID":"7795859b-24f2-497c-ad22-f6f64ee052b1","Type":"ContainerDied","Data":"6f594d9c8431fa6c437192d7e854122f0e3235acfd94255d2b74719a05e25e18"} Sep 07 12:12:19.649766 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:19.649753 2577 scope.go:117] "RemoveContainer" containerID="6f594d9c8431fa6c437192d7e854122f0e3235acfd94255d2b74719a05e25e18" Sep 07 12:12:20.576417 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:20.576362 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:20.626757 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:20.626722 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:20.655169 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:20.655138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-msfcx" event={"ID":"7795859b-24f2-497c-ad22-f6f64ee052b1","Type":"ContainerStarted","Data":"0efef949a201ae7fbb4b6cdd675dc0f37d8e299196b0a9be2ff225fdae166d04"} Sep 07 12:12:24.962147 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:24.962120 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:27.897666 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:27.897639 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:27.914075 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:27.914052 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:28.711077 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:28.711044 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:38.489280 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:38.489242 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:38.599922 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:38.599883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:41.676534 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:41.676495 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:12:41.677108 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:41.676869 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="alertmanager" containerID="cri-o://f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526" gracePeriod=120 Sep 07 12:12:41.677108 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:41.676929 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy-metric" containerID="cri-o://09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c" gracePeriod=120 Sep 07 12:12:41.677108 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:41.676998 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy" containerID="cri-o://209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0" gracePeriod=120 Sep 07 12:12:41.677108 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:41.677019 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="prom-label-proxy" containerID="cri-o://5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68" gracePeriod=120 Sep 07 12:12:41.677108 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:41.677025 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="config-reloader" containerID="cri-o://75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283" gracePeriod=120 Sep 07 12:12:41.677108 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:41.676980 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy-web" containerID="cri-o://cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf" gracePeriod=120 Sep 07 12:12:42.758897 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.758868 2577 generic.go:356] "Generic (PLEG): container finished" podID="572509e8-05d5-438a-aac0-c14360097a14" containerID="5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68" exitCode=0 Sep 07 12:12:42.758897 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.758894 2577 generic.go:356] "Generic (PLEG): container finished" podID="572509e8-05d5-438a-aac0-c14360097a14" containerID="209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0" exitCode=0 Sep 07 12:12:42.758897 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.758900 2577 generic.go:356] "Generic (PLEG): container finished" podID="572509e8-05d5-438a-aac0-c14360097a14" containerID="75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283" exitCode=0 Sep 07 12:12:42.759319 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.758906 2577 generic.go:356] "Generic (PLEG): container finished" podID="572509e8-05d5-438a-aac0-c14360097a14" containerID="f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526" exitCode=0 Sep 07 12:12:42.759319 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.758958 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerDied","Data":"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68"} Sep 07 12:12:42.759319 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.759047 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerDied","Data":"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0"} Sep 07 12:12:42.759319 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.759090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerDied","Data":"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283"} Sep 07 12:12:42.759319 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.759128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerDied","Data":"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526"} Sep 07 12:12:42.932676 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:42.932651 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.028530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028445 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-metric\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028490 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-metrics-client-ca\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028522 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-main-db\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028776 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028548 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-config-volume\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028776 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028583 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-config-out\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028776 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028620 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-web-config\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028776 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028663 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028776 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028694 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-trusted-ca-bundle\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028776 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028733 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-tls-assets\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.028776 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028760 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.029172 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028788 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62f4g\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-kube-api-access-62f4g\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.029172 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028816 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-cluster-tls-config\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.029172 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028859 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-web\") pod \"572509e8-05d5-438a-aac0-c14360097a14\" (UID: \"572509e8-05d5-438a-aac0-c14360097a14\") " Sep 07 12:12:43.029172 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028867 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:12:43.029172 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.028882 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:43.029172 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.029127 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-metrics-client-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.029172 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.029146 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-main-db\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.030294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.030224 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:43.031794 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.031767 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:12:43.032060 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.031931 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-config-out" (OuterVolumeSpecName: "config-out") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:12:43.032198 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.032097 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:43.032268 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.032194 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:43.032268 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.032194 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-kube-api-access-62f4g" (OuterVolumeSpecName: "kube-api-access-62f4g") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "kube-api-access-62f4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:12:43.032379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.032270 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-config-volume" (OuterVolumeSpecName: "config-volume") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:43.032547 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.032521 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:43.033445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.033430 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:43.037210 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.037151 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:43.043845 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.043820 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-web-config" (OuterVolumeSpecName: "web-config") pod "572509e8-05d5-438a-aac0-c14360097a14" (UID: "572509e8-05d5-438a-aac0-c14360097a14"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:43.130060 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130027 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/572509e8-05d5-438a-aac0-c14360097a14-config-out\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130060 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130057 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-web-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130060 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130068 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130221 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130078 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572509e8-05d5-438a-aac0-c14360097a14-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130221 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130086 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-tls-assets\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130221 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130094 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-main-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130221 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130103 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62f4g\" (UniqueName: \"kubernetes.io/projected/572509e8-05d5-438a-aac0-c14360097a14-kube-api-access-62f4g\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130221 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130110 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-cluster-tls-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130221 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130119 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130221 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130128 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.130221 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.130137 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/572509e8-05d5-438a-aac0-c14360097a14-config-volume\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:43.766226 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.766190 2577 generic.go:356] "Generic (PLEG): container finished" podID="572509e8-05d5-438a-aac0-c14360097a14" containerID="09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c" exitCode=0 Sep 07 12:12:43.766226 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.766211 2577 generic.go:356] "Generic (PLEG): container finished" podID="572509e8-05d5-438a-aac0-c14360097a14" containerID="cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf" exitCode=0 Sep 07 12:12:43.766570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.766252 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerDied","Data":"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c"} Sep 07 12:12:43.766570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.766264 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.766570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.766327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerDied","Data":"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf"} Sep 07 12:12:43.766570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.766357 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"572509e8-05d5-438a-aac0-c14360097a14","Type":"ContainerDied","Data":"3c656cc91f124b747a753b62fda8267c822fa9f6cdc8d75799bffe1591c4a389"} Sep 07 12:12:43.766570 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.766396 2577 scope.go:117] "RemoveContainer" containerID="5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68" Sep 07 12:12:43.775076 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.775061 2577 scope.go:117] "RemoveContainer" containerID="09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c" Sep 07 12:12:43.782379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.782360 2577 scope.go:117] "RemoveContainer" containerID="209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0" Sep 07 12:12:43.789015 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.788991 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:12:43.790478 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.790404 2577 scope.go:117] "RemoveContainer" containerID="cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf" Sep 07 12:12:43.795600 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.795581 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:12:43.798210 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.798071 2577 scope.go:117] "RemoveContainer" containerID="75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283" Sep 07 12:12:43.805030 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.805013 2577 scope.go:117] "RemoveContainer" containerID="f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526" Sep 07 12:12:43.812502 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.812485 2577 scope.go:117] "RemoveContainer" containerID="b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e" Sep 07 12:12:43.818490 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818472 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:12:43.818812 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818797 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="alertmanager" Sep 07 12:12:43.818890 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818816 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="alertmanager" Sep 07 12:12:43.818890 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818837 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy-web" Sep 07 12:12:43.818890 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818847 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy-web" Sep 07 12:12:43.818890 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818860 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy" Sep 07 12:12:43.818890 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818868 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy" Sep 07 12:12:43.818890 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818879 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="prom-label-proxy" Sep 07 12:12:43.818890 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818887 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="prom-label-proxy" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818900 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="init-config-reloader" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818908 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="init-config-reloader" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818922 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" containerName="registry" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818931 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" containerName="registry" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818959 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="config-reloader" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818967 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="config-reloader" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818983 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy-metric" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.818992 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy-metric" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.819070 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="alertmanager" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.819084 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1ccaa88-dcbe-4776-88a0-6b73e9931cdd" containerName="registry" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.819092 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy-web" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.819102 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="config-reloader" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.819110 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy-metric" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.819117 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="prom-label-proxy" Sep 07 12:12:43.819253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.819125 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="572509e8-05d5-438a-aac0-c14360097a14" containerName="kube-rbac-proxy" Sep 07 12:12:43.819974 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.819891 2577 scope.go:117] "RemoveContainer" containerID="5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68" Sep 07 12:12:43.820190 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:43.820168 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68\": container with ID starting with 5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68 not found: ID does not exist" containerID="5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68" Sep 07 12:12:43.820289 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.820198 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68"} err="failed to get container status \"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68\": rpc error: code = NotFound desc = could not find container \"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68\": container with ID starting with 5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68 not found: ID does not exist" Sep 07 12:12:43.820289 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.820221 2577 scope.go:117] "RemoveContainer" containerID="09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c" Sep 07 12:12:43.820535 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:43.820512 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c\": container with ID starting with 09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c not found: ID does not exist" containerID="09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c" Sep 07 12:12:43.820583 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.820541 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c"} err="failed to get container status \"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c\": rpc error: code = NotFound desc = could not find container \"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c\": container with ID starting with 09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c not found: ID does not exist" Sep 07 12:12:43.820583 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.820557 2577 scope.go:117] "RemoveContainer" containerID="209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0" Sep 07 12:12:43.820797 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:43.820779 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0\": container with ID starting with 209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0 not found: ID does not exist" containerID="209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0" Sep 07 12:12:43.820860 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.820805 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0"} err="failed to get container status \"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0\": rpc error: code = NotFound desc = could not find container \"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0\": container with ID starting with 209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0 not found: ID does not exist" Sep 07 12:12:43.820860 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.820826 2577 scope.go:117] "RemoveContainer" containerID="cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf" Sep 07 12:12:43.821110 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:43.821094 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf\": container with ID starting with cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf not found: ID does not exist" containerID="cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf" Sep 07 12:12:43.821153 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.821113 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf"} err="failed to get container status \"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf\": rpc error: code = NotFound desc = could not find container \"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf\": container with ID starting with cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf not found: ID does not exist" Sep 07 12:12:43.821153 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.821127 2577 scope.go:117] "RemoveContainer" containerID="75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283" Sep 07 12:12:43.821344 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:43.821331 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283\": container with ID starting with 75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283 not found: ID does not exist" containerID="75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283" Sep 07 12:12:43.821385 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.821346 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283"} err="failed to get container status \"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283\": rpc error: code = NotFound desc = could not find container \"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283\": container with ID starting with 75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283 not found: ID does not exist" Sep 07 12:12:43.821385 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.821357 2577 scope.go:117] "RemoveContainer" containerID="f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526" Sep 07 12:12:43.821608 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:43.821570 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526\": container with ID starting with f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526 not found: ID does not exist" containerID="f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526" Sep 07 12:12:43.821675 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.821639 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526"} err="failed to get container status \"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526\": rpc error: code = NotFound desc = could not find container \"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526\": container with ID starting with f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526 not found: ID does not exist" Sep 07 12:12:43.821675 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.821659 2577 scope.go:117] "RemoveContainer" containerID="b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e" Sep 07 12:12:43.821898 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:43.821884 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e\": container with ID starting with b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e not found: ID does not exist" containerID="b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e" Sep 07 12:12:43.821989 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.821903 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e"} err="failed to get container status \"b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e\": rpc error: code = NotFound desc = could not find container \"b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e\": container with ID starting with b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e not found: ID does not exist" Sep 07 12:12:43.821989 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.821923 2577 scope.go:117] "RemoveContainer" containerID="5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68" Sep 07 12:12:43.822194 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.822177 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68"} err="failed to get container status \"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68\": rpc error: code = NotFound desc = could not find container \"5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68\": container with ID starting with 5844704e655c3778fa67c86190a81d06090a25524f50d86d634ffb34fa62cf68 not found: ID does not exist" Sep 07 12:12:43.822248 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.822195 2577 scope.go:117] "RemoveContainer" containerID="09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c" Sep 07 12:12:43.822427 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.822409 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c"} err="failed to get container status \"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c\": rpc error: code = NotFound desc = could not find container \"09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c\": container with ID starting with 09c5096e462cee966bb16794b14d4395efe346ade9ecbe85d3b9493b3f4ae48c not found: ID does not exist" Sep 07 12:12:43.822494 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.822428 2577 scope.go:117] "RemoveContainer" containerID="209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0" Sep 07 12:12:43.822654 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.822637 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0"} err="failed to get container status \"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0\": rpc error: code = NotFound desc = could not find container \"209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0\": container with ID starting with 209db01382c9b630e22b5a4db43cf1004fdd47d5e6262113947152ed00a9e5a0 not found: ID does not exist" Sep 07 12:12:43.822700 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.822656 2577 scope.go:117] "RemoveContainer" containerID="cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf" Sep 07 12:12:43.822862 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.822848 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf"} err="failed to get container status \"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf\": rpc error: code = NotFound desc = could not find container \"cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf\": container with ID starting with cee03c5f401f3702836e7b69388aabc0bbf42ac7bb464e42aa9b0a7ebf583ebf not found: ID does not exist" Sep 07 12:12:43.822862 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.822861 2577 scope.go:117] "RemoveContainer" containerID="75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283" Sep 07 12:12:43.823086 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.823069 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283"} err="failed to get container status \"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283\": rpc error: code = NotFound desc = could not find container \"75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283\": container with ID starting with 75ee028bccb5c616b164d85c41333dd993a85b6c2475c9680e267e05d3d93283 not found: ID does not exist" Sep 07 12:12:43.823086 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.823086 2577 scope.go:117] "RemoveContainer" containerID="f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526" Sep 07 12:12:43.823298 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.823281 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526"} err="failed to get container status \"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526\": rpc error: code = NotFound desc = could not find container \"f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526\": container with ID starting with f01d2b7e5ff78012d207d13d74017f972969fea20bdf7bc58f8dfa9d4e677526 not found: ID does not exist" Sep 07 12:12:43.823341 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.823299 2577 scope.go:117] "RemoveContainer" containerID="b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e" Sep 07 12:12:43.823483 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.823468 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e"} err="failed to get container status \"b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e\": rpc error: code = NotFound desc = could not find container \"b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e\": container with ID starting with b10c9ea451f24d099d44e53f07557e6cdb71a084b7859bade499c5f5847fe98e not found: ID does not exist" Sep 07 12:12:43.824469 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.824452 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.827068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827004 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 07 12:12:43.827068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827009 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 07 12:12:43.827068 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827039 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 07 12:12:43.827322 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827039 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 07 12:12:43.827322 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827106 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hrdch\"" Sep 07 12:12:43.827442 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827422 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 07 12:12:43.827575 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827545 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 07 12:12:43.827575 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 07 12:12:43.827678 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.827634 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 07 12:12:43.831915 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.831896 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 07 12:12:43.834645 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.834623 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:12:43.834983 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.834964 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835035 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835072 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f322b12-26fd-45b1-ad13-e4e585488fe3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835103 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835148 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835133 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7n84\" (UniqueName: \"kubernetes.io/projected/5f322b12-26fd-45b1-ad13-e4e585488fe3-kube-api-access-n7n84\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835218 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835262 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f322b12-26fd-45b1-ad13-e4e585488fe3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835328 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f322b12-26fd-45b1-ad13-e4e585488fe3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835383 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835438 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-web-config\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835438 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f322b12-26fd-45b1-ad13-e4e585488fe3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835536 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.835536 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.835496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f322b12-26fd-45b1-ad13-e4e585488fe3-config-out\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936453 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-web-config\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936585 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f322b12-26fd-45b1-ad13-e4e585488fe3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936585 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936585 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f322b12-26fd-45b1-ad13-e4e585488fe3-config-out\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936585 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936528 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936585 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f322b12-26fd-45b1-ad13-e4e585488fe3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7n84\" (UniqueName: \"kubernetes.io/projected/5f322b12-26fd-45b1-ad13-e4e585488fe3-kube-api-access-n7n84\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936670 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936707 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f322b12-26fd-45b1-ad13-e4e585488fe3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936741 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f322b12-26fd-45b1-ad13-e4e585488fe3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.936854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.937226 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.936862 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f322b12-26fd-45b1-ad13-e4e585488fe3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.937532 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.937507 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f322b12-26fd-45b1-ad13-e4e585488fe3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.938793 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.938764 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f322b12-26fd-45b1-ad13-e4e585488fe3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.940008 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.939914 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.940008 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.939938 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.940008 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.939933 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-web-config\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.940445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.940423 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.940690 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.940669 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.940752 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.940723 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.940790 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.940752 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f322b12-26fd-45b1-ad13-e4e585488fe3-config-out\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.940885 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.940870 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f322b12-26fd-45b1-ad13-e4e585488fe3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.941403 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.941386 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f322b12-26fd-45b1-ad13-e4e585488fe3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.945934 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.945903 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7n84\" (UniqueName: \"kubernetes.io/projected/5f322b12-26fd-45b1-ad13-e4e585488fe3-kube-api-access-n7n84\") pod \"alertmanager-main-0\" (UID: \"5f322b12-26fd-45b1-ad13-e4e585488fe3\") " pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:43.972707 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:43.972676 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="572509e8-05d5-438a-aac0-c14360097a14" path="/var/lib/kubelet/pods/572509e8-05d5-438a-aac0-c14360097a14/volumes" Sep 07 12:12:44.134618 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:44.134592 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 07 12:12:44.413535 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:44.413487 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 07 12:12:44.415551 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:12:44.415523 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f322b12_26fd_45b1_ad13_e4e585488fe3.slice/crio-e02153f2fdd669791ed3ce1691bb9a439d3d10f2b31bcb3becf9141557bc7a13 WatchSource:0}: Error finding container e02153f2fdd669791ed3ce1691bb9a439d3d10f2b31bcb3becf9141557bc7a13: Status 404 returned error can't find the container with id e02153f2fdd669791ed3ce1691bb9a439d3d10f2b31bcb3becf9141557bc7a13 Sep 07 12:12:44.772751 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:44.772673 2577 generic.go:356] "Generic (PLEG): container finished" podID="5f322b12-26fd-45b1-ad13-e4e585488fe3" containerID="7eb7cd6350cbf9ab584342e01ac1008b90e266c7b74f502e2663d3df0d941f52" exitCode=0 Sep 07 12:12:44.772751 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:44.772733 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f322b12-26fd-45b1-ad13-e4e585488fe3","Type":"ContainerDied","Data":"7eb7cd6350cbf9ab584342e01ac1008b90e266c7b74f502e2663d3df0d941f52"} Sep 07 12:12:44.773137 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:44.772786 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f322b12-26fd-45b1-ad13-e4e585488fe3","Type":"ContainerStarted","Data":"e02153f2fdd669791ed3ce1691bb9a439d3d10f2b31bcb3becf9141557bc7a13"} Sep 07 12:12:45.781111 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.781072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f322b12-26fd-45b1-ad13-e4e585488fe3","Type":"ContainerStarted","Data":"13c15efbe18eea01760cfb98889265f965b6a4a96a0bcf9b3644c9cf8b2c5bcc"} Sep 07 12:12:45.781531 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.781148 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f322b12-26fd-45b1-ad13-e4e585488fe3","Type":"ContainerStarted","Data":"a9d7822389171c512e08674719af95028daa19971a1f03fcd3e1902744cb9fa4"} Sep 07 12:12:45.781531 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.781191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f322b12-26fd-45b1-ad13-e4e585488fe3","Type":"ContainerStarted","Data":"06420f86893d071db2b0b39b86aa81ee1603e3d95eadc827b195ffb49e372c40"} Sep 07 12:12:45.781531 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.781235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f322b12-26fd-45b1-ad13-e4e585488fe3","Type":"ContainerStarted","Data":"b25ead66eb903b8f8a1fc1596f18534531d48d39ae08d053acc05ea2f64cde86"} Sep 07 12:12:45.781531 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.781274 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f322b12-26fd-45b1-ad13-e4e585488fe3","Type":"ContainerStarted","Data":"4bb8ed85aa6b666d5c70e4248268c732299df23deff736a29be60e858a7dca77"} Sep 07 12:12:45.781531 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.781310 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f322b12-26fd-45b1-ad13-e4e585488fe3","Type":"ContainerStarted","Data":"2fcd1cc1f1e7452e72f20f2e4a64665b99e971099855b9aa439320b18074a55f"} Sep 07 12:12:45.806204 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.806159 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.790946404 podStartE2EDuration="2.806142879s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.196475ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:12:45.803563652 +0000 UTC m=+166.327979961" watchObservedRunningTime="2026-09-07 12:12:45.806142879 +0000 UTC m=+166.330559195" Sep 07 12:12:45.923223 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.923189 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:12:45.923498 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.923473 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="prometheus" containerID="cri-o://224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4" gracePeriod=600 Sep 07 12:12:45.923562 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.923492 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy" containerID="cri-o://815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5" gracePeriod=600 Sep 07 12:12:45.923562 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.923527 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy-web" containerID="cri-o://15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257" gracePeriod=600 Sep 07 12:12:45.923669 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.923571 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="config-reloader" containerID="cri-o://3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f" gracePeriod=600 Sep 07 12:12:45.923669 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.923524 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="thanos-sidecar" containerID="cri-o://752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249" gracePeriod=600 Sep 07 12:12:45.923669 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:45.923527 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746" gracePeriod=600 Sep 07 12:12:46.789308 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789274 2577 generic.go:356] "Generic (PLEG): container finished" podID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerID="c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746" exitCode=0 Sep 07 12:12:46.789308 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789297 2577 generic.go:356] "Generic (PLEG): container finished" podID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerID="815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5" exitCode=0 Sep 07 12:12:46.789308 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789304 2577 generic.go:356] "Generic (PLEG): container finished" podID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerID="752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249" exitCode=0 Sep 07 12:12:46.789308 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789310 2577 generic.go:356] "Generic (PLEG): container finished" podID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerID="3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f" exitCode=0 Sep 07 12:12:46.789308 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789316 2577 generic.go:356] "Generic (PLEG): container finished" podID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerID="224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4" exitCode=0 Sep 07 12:12:46.789842 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789345 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerDied","Data":"c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746"} Sep 07 12:12:46.789842 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789412 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerDied","Data":"815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5"} Sep 07 12:12:46.789842 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789441 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerDied","Data":"752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249"} Sep 07 12:12:46.789842 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerDied","Data":"3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f"} Sep 07 12:12:46.789842 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:46.789489 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerDied","Data":"224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4"} Sep 07 12:12:47.173014 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.172990 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266372 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-metrics-client-ca\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266431 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-db\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266483 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-serving-certs-ca-bundle\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266515 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-tls-assets\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266577 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266610 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-1\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266651 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-metrics-client-certs\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266677 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-kube-rbac-proxy\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266704 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-grpc-tls\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266772 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-0\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266803 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82dcp\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-kube-api-access-82dcp\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266835 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config-out\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266864 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-thanos-prometheus-http-client-file\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266894 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-2\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266937 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-tls\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.266990 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-kubelet-serving-ca-bundle\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.267019 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.271292 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.267051 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-trusted-ca-bundle\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.272370 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.267078 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.272370 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.267108 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-web-config\") pod \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\" (UID: \"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f\") " Sep 07 12:12:47.272370 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.271620 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:47.272370 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.271683 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:47.273158 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.273125 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:47.273158 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.273138 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:47.273347 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.273202 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:47.274020 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.273992 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:47.275379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.274866 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:12:47.275379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.274792 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 12:12:47.275379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.275001 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.275379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.275268 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config-out" (OuterVolumeSpecName: "config-out") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:12:47.275379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.275362 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-kube-api-access-82dcp" (OuterVolumeSpecName: "kube-api-access-82dcp") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "kube-api-access-82dcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:12:47.275687 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.275425 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.275746 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.275692 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.276801 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.276764 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:12:47.276910 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.276794 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config" (OuterVolumeSpecName: "config") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.277164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.277139 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.277640 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.277620 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.278093 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.278065 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.278195 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.278091 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.285073 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.285053 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-web-config" (OuterVolumeSpecName: "web-config") pod "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" (UID: "f14d4bdc-bf7f-408c-8b0a-55bd8eda738f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 12:12:47.368760 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368739 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368760 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368758 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-tls-assets\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368768 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368777 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368785 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-metrics-client-certs\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368793 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-kube-rbac-proxy\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368801 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-grpc-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368809 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368816 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82dcp\" (UniqueName: \"kubernetes.io/projected/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-kube-api-access-82dcp\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368824 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config-out\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368832 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368841 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368848 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368856 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368864 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368872 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368880 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368887 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-web-config\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.368889 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368895 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-configmap-metrics-client-ca\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.369403 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.368903 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f-prometheus-k8s-db\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:12:47.797210 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.797176 2577 generic.go:356] "Generic (PLEG): container finished" podID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerID="15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257" exitCode=0 Sep 07 12:12:47.797644 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.797254 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerDied","Data":"15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257"} Sep 07 12:12:47.797644 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.797297 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.797644 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.797339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f14d4bdc-bf7f-408c-8b0a-55bd8eda738f","Type":"ContainerDied","Data":"e2e742b4bb74dec1831ca9b51e1c92f56b354e0fd1257bc8b562f9d50100a02a"} Sep 07 12:12:47.797644 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.797371 2577 scope.go:117] "RemoveContainer" containerID="c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746" Sep 07 12:12:47.806061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.805912 2577 scope.go:117] "RemoveContainer" containerID="815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5" Sep 07 12:12:47.813654 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.813633 2577 scope.go:117] "RemoveContainer" containerID="15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257" Sep 07 12:12:47.820138 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.820119 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:12:47.820871 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.820850 2577 scope.go:117] "RemoveContainer" containerID="752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249" Sep 07 12:12:47.825396 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.825377 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:12:47.828823 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.828806 2577 scope.go:117] "RemoveContainer" containerID="3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f" Sep 07 12:12:47.835719 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.835702 2577 scope.go:117] "RemoveContainer" containerID="224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4" Sep 07 12:12:47.843054 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.843038 2577 scope.go:117] "RemoveContainer" containerID="6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129" Sep 07 12:12:47.849878 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.849862 2577 scope.go:117] "RemoveContainer" containerID="c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746" Sep 07 12:12:47.850168 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:47.850152 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746\": container with ID starting with c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746 not found: ID does not exist" containerID="c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746" Sep 07 12:12:47.850224 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.850176 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746"} err="failed to get container status \"c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746\": rpc error: code = NotFound desc = could not find container \"c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746\": container with ID starting with c96f628ec8511b694cf6350b6de4b97d75a1f4c4c97b7d4504d5604c79dd4746 not found: ID does not exist" Sep 07 12:12:47.850224 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.850192 2577 scope.go:117] "RemoveContainer" containerID="815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5" Sep 07 12:12:47.850402 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:47.850389 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5\": container with ID starting with 815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5 not found: ID does not exist" containerID="815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5" Sep 07 12:12:47.850444 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.850405 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5"} err="failed to get container status \"815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5\": rpc error: code = NotFound desc = could not find container \"815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5\": container with ID starting with 815eae23bb3c38e265476412257d590525d5954e45289e8fbcd093cfa4c3d4d5 not found: ID does not exist" Sep 07 12:12:47.850444 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.850417 2577 scope.go:117] "RemoveContainer" containerID="15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257" Sep 07 12:12:47.850656 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:47.850642 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257\": container with ID starting with 15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257 not found: ID does not exist" containerID="15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257" Sep 07 12:12:47.850698 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.850658 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257"} err="failed to get container status \"15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257\": rpc error: code = NotFound desc = could not find container \"15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257\": container with ID starting with 15850c8a5a60300471ff3844f0302d0bac5d75b652655f488ff516e6fa90b257 not found: ID does not exist" Sep 07 12:12:47.850698 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.850669 2577 scope.go:117] "RemoveContainer" containerID="752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249" Sep 07 12:12:47.850873 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:47.850856 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249\": container with ID starting with 752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249 not found: ID does not exist" containerID="752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249" Sep 07 12:12:47.850915 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.850877 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249"} err="failed to get container status \"752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249\": rpc error: code = NotFound desc = could not find container \"752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249\": container with ID starting with 752ca387fc4a0fdefc7003cdaf5d6ee37a6e62a1d2e8166f8e490bd58ec24249 not found: ID does not exist" Sep 07 12:12:47.850915 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.850891 2577 scope.go:117] "RemoveContainer" containerID="3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f" Sep 07 12:12:47.851166 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:47.851147 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f\": container with ID starting with 3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f not found: ID does not exist" containerID="3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f" Sep 07 12:12:47.851265 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.851173 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f"} err="failed to get container status \"3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f\": rpc error: code = NotFound desc = could not find container \"3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f\": container with ID starting with 3a8a6696330d137e41b0b952bd0444e4a97bddafad0cb85f0e549125d238c22f not found: ID does not exist" Sep 07 12:12:47.851265 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.851193 2577 scope.go:117] "RemoveContainer" containerID="224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4" Sep 07 12:12:47.851481 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:47.851464 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4\": container with ID starting with 224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4 not found: ID does not exist" containerID="224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4" Sep 07 12:12:47.851549 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.851485 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4"} err="failed to get container status \"224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4\": rpc error: code = NotFound desc = could not find container \"224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4\": container with ID starting with 224e0a049fcb8fbaf01ac8d5a80d4adce81b292292ed11846004be28ef664df4 not found: ID does not exist" Sep 07 12:12:47.851549 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.851499 2577 scope.go:117] "RemoveContainer" containerID="6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129" Sep 07 12:12:47.851774 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:12:47.851755 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129\": container with ID starting with 6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129 not found: ID does not exist" containerID="6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129" Sep 07 12:12:47.851845 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.851780 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129"} err="failed to get container status \"6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129\": rpc error: code = NotFound desc = could not find container \"6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129\": container with ID starting with 6da54c652cd48180da88a8acf9fd5fbe01e537bf523ba63a1226831e33d33129 not found: ID does not exist" Sep 07 12:12:47.859185 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859163 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:12:47.859467 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859454 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="config-reloader" Sep 07 12:12:47.859467 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859467 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="config-reloader" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859478 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="init-config-reloader" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859484 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="init-config-reloader" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859493 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="prometheus" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859499 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="prometheus" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859509 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy-thanos" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859514 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy-thanos" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859521 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="thanos-sidecar" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859526 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="thanos-sidecar" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859537 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859541 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859549 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy-web" Sep 07 12:12:47.859579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859554 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy-web" Sep 07 12:12:47.860004 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859615 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy-web" Sep 07 12:12:47.860004 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859628 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy" Sep 07 12:12:47.860004 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859636 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="prometheus" Sep 07 12:12:47.860004 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859646 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="thanos-sidecar" Sep 07 12:12:47.860004 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859653 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="kube-rbac-proxy-thanos" Sep 07 12:12:47.860004 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.859660 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" containerName="config-reloader" Sep 07 12:12:47.865596 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.865578 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.868894 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.868876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 07 12:12:47.868894 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.868886 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-213e96g7gk7q7\"" Sep 07 12:12:47.869053 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.868887 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 07 12:12:47.869298 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.869277 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 07 12:12:47.869384 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.869271 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 07 12:12:47.869384 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.869284 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 07 12:12:47.869718 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.869700 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 07 12:12:47.869797 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.869700 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 07 12:12:47.869854 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.869817 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 07 12:12:47.870011 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.869997 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 07 12:12:47.870087 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.870043 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 07 12:12:47.870446 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.870431 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bfhxw\"" Sep 07 12:12:47.870592 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.870576 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 07 12:12:47.870679 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.870666 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 12:12:47.871011 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.870994 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 07 12:12:47.875764 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.875738 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 07 12:12:47.878175 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.878158 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 07 12:12:47.885706 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.885686 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:12:47.916635 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.916587 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:47.974147 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974123 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl7jr\" (UniqueName: \"kubernetes.io/projected/7ff498a6-5378-4113-a902-db1e88dff5d4-kube-api-access-fl7jr\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff498a6-5378-4113-a902-db1e88dff5d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff498a6-5378-4113-a902-db1e88dff5d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974461 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-config\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.974748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.974728 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:47.975219 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:47.975201 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14d4bdc-bf7f-408c-8b0a-55bd8eda738f" path="/var/lib/kubelet/pods/f14d4bdc-bf7f-408c-8b0a-55bd8eda738f/volumes" Sep 07 12:12:48.075803 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.075748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.075803 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.075776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.075803 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.075800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076052 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.075823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076052 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.075837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl7jr\" (UniqueName: \"kubernetes.io/projected/7ff498a6-5378-4113-a902-db1e88dff5d4-kube-api-access-fl7jr\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076052 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.075907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076052 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.075969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076052 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076002 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076052 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076033 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff498a6-5378-4113-a902-db1e88dff5d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff498a6-5378-4113-a902-db1e88dff5d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076196 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-config\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076283 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.076338 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.076378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.077116 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.077578 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.077924 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.078114 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.078601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.078758 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.079206 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.079371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7ff498a6-5378-4113-a902-db1e88dff5d4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.079750 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.080275 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.080957 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-config\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.080977 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081164 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.081045 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7ff498a6-5378-4113-a902-db1e88dff5d4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081918 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.081213 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7ff498a6-5378-4113-a902-db1e88dff5d4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.081918 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.081915 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.082070 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.081988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.082132 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.082106 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.082323 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.082305 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.082808 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.082791 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7ff498a6-5378-4113-a902-db1e88dff5d4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.083620 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.083605 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl7jr\" (UniqueName: \"kubernetes.io/projected/7ff498a6-5378-4113-a902-db1e88dff5d4-kube-api-access-fl7jr\") pod \"prometheus-k8s-0\" (UID: \"7ff498a6-5378-4113-a902-db1e88dff5d4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.176725 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.176701 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:48.459073 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.459048 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 07 12:12:48.460762 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:12:48.460736 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff498a6_5378_4113_a902_db1e88dff5d4.slice/crio-6b3abb3ab5663be24d723214676672d17f80512094e5e67d09dc24b5e47b4442 WatchSource:0}: Error finding container 6b3abb3ab5663be24d723214676672d17f80512094e5e67d09dc24b5e47b4442: Status 404 returned error can't find the container with id 6b3abb3ab5663be24d723214676672d17f80512094e5e67d09dc24b5e47b4442 Sep 07 12:12:48.612707 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.612677 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:48.713264 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.713176 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:48.804061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.804031 2577 generic.go:356] "Generic (PLEG): container finished" podID="7ff498a6-5378-4113-a902-db1e88dff5d4" containerID="b919189339bf2a2553a9857d5ebf03347ed166ade21d5dc8344c11ebabcadd58" exitCode=0 Sep 07 12:12:48.804480 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.804127 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff498a6-5378-4113-a902-db1e88dff5d4","Type":"ContainerDied","Data":"b919189339bf2a2553a9857d5ebf03347ed166ade21d5dc8344c11ebabcadd58"} Sep 07 12:12:48.804480 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:48.804223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff498a6-5378-4113-a902-db1e88dff5d4","Type":"ContainerStarted","Data":"6b3abb3ab5663be24d723214676672d17f80512094e5e67d09dc24b5e47b4442"} Sep 07 12:12:49.339914 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.339877 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:49.440893 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.440862 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:49.812666 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.812596 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff498a6-5378-4113-a902-db1e88dff5d4","Type":"ContainerStarted","Data":"75656e7ff0d3754754a004cede964ea8ea8298a84f4ea531f172492367275b4b"} Sep 07 12:12:49.813059 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.812685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff498a6-5378-4113-a902-db1e88dff5d4","Type":"ContainerStarted","Data":"87b79b750909b66e20d2f1fdf2d6d1c57b01ee83e588c45897f15a11767f4d51"} Sep 07 12:12:49.813059 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.812711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff498a6-5378-4113-a902-db1e88dff5d4","Type":"ContainerStarted","Data":"e7228b2200ae401913de8f15647b4591ef5dd03523f3d81e2220c34e8701d321"} Sep 07 12:12:49.813059 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.812734 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff498a6-5378-4113-a902-db1e88dff5d4","Type":"ContainerStarted","Data":"750280c3de9a7c47ae9b9c0b5560afe8f2595bdb6a1c06232f86fefbdb9446f4"} Sep 07 12:12:49.813059 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.812757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff498a6-5378-4113-a902-db1e88dff5d4","Type":"ContainerStarted","Data":"187dbdd6d18fdeb837b9ed4f9f9bf647da4eb433e3b8ed9bd049e252aebe0951"} Sep 07 12:12:49.813059 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.812778 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7ff498a6-5378-4113-a902-db1e88dff5d4","Type":"ContainerStarted","Data":"8d1add48d93f27bef3f09fb0fa4c75d1c63ef05ef83453ed9b265da40d2e15c3"} Sep 07 12:12:49.840547 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:49.840498 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.821146835 podStartE2EDuration="2.840482819s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.335984ms" isStatefulPod=false podCreationTimestamp="2026-09-07 12:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:12:49.837305511 +0000 UTC m=+170.361721816" watchObservedRunningTime="2026-09-07 12:12:49.840482819 +0000 UTC m=+170.364899108" Sep 07 12:12:53.177416 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:53.177333 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:12:55.287045 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:55.286998 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:55.387259 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:55.387225 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:58.527842 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:58.527810 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:58.628479 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:58.628445 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:58.681013 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:58.680982 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:12:59.963591 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:12:59.963562 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:13:06.622259 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:13:06.622220 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:13:48.177795 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:13:48.177765 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:13:48.193423 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:13:48.193402 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:13:49.066162 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:13:49.066137 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 07 12:13:50.619428 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:13:50.619391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:12.640997 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:12.640960 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:12.741300 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:12.741269 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:34.178598 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:34.178562 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:34.939396 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:34.939360 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:37.584207 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:37.584172 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:37.635314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:37.635272 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:39.906965 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:39.906911 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:41.602425 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:41.602391 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:42.181148 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:42.181115 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:42.281790 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:42.281745 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:42.382462 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:42.382435 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:42.713647 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:42.713621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:49.923141 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:49.923103 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:53.964483 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:53.964434 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:54.063293 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:54.063266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:14:59.901853 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:59.901822 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/1.log" Sep 07 12:14:59.907868 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:59.907843 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/1.log" Sep 07 12:14:59.912818 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:14:59.912797 2577 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 12:15:05.399869 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:05.399837 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:05.494707 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:05.494668 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:14.866341 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:14.866294 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:16.715905 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:16.715867 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:16.817299 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:16.817268 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:16.867868 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:16.867841 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:21.774105 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:21.774072 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:21.825811 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:21.825778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:37.236596 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:37.236560 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:37.335157 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:37.335105 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:40.207860 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.207830 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6"] Sep 07 12:15:40.210294 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.210266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:40.211384 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.211365 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.214097 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.214072 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 07 12:15:40.214205 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.214168 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 07 12:15:40.214205 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.214176 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 07 12:15:40.215069 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.215052 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-wssqg\"" Sep 07 12:15:40.215147 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.215079 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 07 12:15:40.219155 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.219137 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6"] Sep 07 12:15:40.266571 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.266545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.266676 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.266610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf5g5\" (UniqueName: \"kubernetes.io/projected/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-kube-api-access-cf5g5\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.266676 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.266630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-cert\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.306638 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.306616 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:40.367697 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.367678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf5g5\" (UniqueName: \"kubernetes.io/projected/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-kube-api-access-cf5g5\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.367792 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.367703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-cert\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.367792 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.367725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.368400 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.368380 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.370097 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.370082 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-cert\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.375918 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.375889 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf5g5\" (UniqueName: \"kubernetes.io/projected/3bacdc9f-ef0e-4bab-a814-e2d0e8486f14-kube-api-access-cf5g5\") pod \"kubeflow-trainer-controller-manager-6c5f978f76-pcfq6\" (UID: \"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14\") " pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.531408 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.531319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:40.798505 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.798484 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6"] Sep 07 12:15:40.801352 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:15:40.801326 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bacdc9f_ef0e_4bab_a814_e2d0e8486f14.slice/crio-2a73ef6032f773f8c14858ef8c29f5458ed7d478371b20b5108399f62c3ba57b WatchSource:0}: Error finding container 2a73ef6032f773f8c14858ef8c29f5458ed7d478371b20b5108399f62c3ba57b: Status 404 returned error can't find the container with id 2a73ef6032f773f8c14858ef8c29f5458ed7d478371b20b5108399f62c3ba57b Sep 07 12:15:40.803573 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:40.803553 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:15:41.507202 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:41.507162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" event={"ID":"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14","Type":"ContainerStarted","Data":"2a73ef6032f773f8c14858ef8c29f5458ed7d478371b20b5108399f62c3ba57b"} Sep 07 12:15:43.517139 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:43.517043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" event={"ID":"3bacdc9f-ef0e-4bab-a814-e2d0e8486f14","Type":"ContainerStarted","Data":"adb119f0a3582234b188b5b0915d26079a478b0a6e7a1455df70c23daa8b8f23"} Sep 07 12:15:43.517578 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:43.517186 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:15:43.532596 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:43.532555 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" podStartSLOduration=1.200101149 podStartE2EDuration="3.532541611s" totalImagesPullingTime="2.332440462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:15:43.530746034 +0000 UTC m=+344.055162347" watchObservedRunningTime="2026-09-07 12:15:43.532541611 +0000 UTC m=+344.056957900" Sep 07 12:15:43.730631 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:43.730597 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:43.833253 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:43.833178 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:45.535227 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:45.535187 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:45.599768 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:45.599736 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:47.480207 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:47.480171 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:47.533692 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:47.533663 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:58.188238 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:58.188156 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:58.246314 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:58.246282 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:15:59.526056 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:15:59.526028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-6c5f978f76-pcfq6" Sep 07 12:16:38.289114 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:16:38.289080 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:16:38.338753 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:16:38.338722 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:03.110527 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:03.110485 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:03.257015 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:03.256977 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:03.306013 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:03.305986 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:03.850064 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:03.850035 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:03.896969 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:03.896907 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:14.457472 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:14.457439 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:14.558320 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:14.558288 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:14.606099 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:14.606070 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:19.408049 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.408013 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:19.509225 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.509194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:19.570362 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.570327 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:17:19.571209 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.571190 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm"] Sep 07 12:17:19.574527 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.574512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:17:19.576776 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.576746 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-v84t8\"/\"openshift-service-ca.crt\"" Sep 07 12:17:19.576872 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.576746 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-v84t8\"/\"default-dockercfg-997p2\"" Sep 07 12:17:19.576872 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.576803 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-v84t8\"/\"kube-root-ca.crt\"" Sep 07 12:17:19.582748 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.582717 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm"] Sep 07 12:17:19.649452 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.649420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg9t6\" (UniqueName: \"kubernetes.io/projected/3ed3ab74-3323-494e-9a2f-e38489b15d15-kube-api-access-cg9t6\") pod \"progression-enabled-node-0-0-hsktm\" (UID: \"3ed3ab74-3323-494e-9a2f-e38489b15d15\") " pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:17:19.749894 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.749826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg9t6\" (UniqueName: \"kubernetes.io/projected/3ed3ab74-3323-494e-9a2f-e38489b15d15-kube-api-access-cg9t6\") pod \"progression-enabled-node-0-0-hsktm\" (UID: \"3ed3ab74-3323-494e-9a2f-e38489b15d15\") " pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:17:19.757061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.757038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg9t6\" (UniqueName: \"kubernetes.io/projected/3ed3ab74-3323-494e-9a2f-e38489b15d15-kube-api-access-cg9t6\") pod \"progression-enabled-node-0-0-hsktm\" (UID: \"3ed3ab74-3323-494e-9a2f-e38489b15d15\") " pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:17:19.884625 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:19.884591 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:17:20.156098 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:20.156064 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm"] Sep 07 12:17:20.159633 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:17:20.159605 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed3ab74_3323_494e_9a2f_e38489b15d15.slice/crio-144e9d1af6c88db65006b527751ae279d965b5aafb04cd58ba77ea4854d630a6 WatchSource:0}: Error finding container 144e9d1af6c88db65006b527751ae279d965b5aafb04cd58ba77ea4854d630a6: Status 404 returned error can't find the container with id 144e9d1af6c88db65006b527751ae279d965b5aafb04cd58ba77ea4854d630a6 Sep 07 12:17:20.921789 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:20.921711 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" event={"ID":"3ed3ab74-3323-494e-9a2f-e38489b15d15","Type":"ContainerStarted","Data":"144e9d1af6c88db65006b527751ae279d965b5aafb04cd58ba77ea4854d630a6"} Sep 07 12:17:22.924200 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:17:22.924163 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:19:02.418597 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:02.418565 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" event={"ID":"3ed3ab74-3323-494e-9a2f-e38489b15d15","Type":"ContainerStarted","Data":"12c4d18ee9c41cffb6f909ff7af69da70081076f56735419f78d96e786f26f31"} Sep 07 12:19:03.422548 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:03.422513 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:19:03.440390 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:03.440337 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" podStartSLOduration=2.295558807 podStartE2EDuration="1m44.440320255s" totalImagesPullingTime="1m42.144761448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:19:03.438501579 +0000 UTC m=+543.962917894" watchObservedRunningTime="2026-09-07 12:19:03.440320255 +0000 UTC m=+543.964736545" Sep 07 12:19:04.425915 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:04.425881 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:19:25.458347 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:25.458296 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" podUID="3ed3ab74-3323-494e-9a2f-e38489b15d15" containerName="node" probeResult="failure" output="Get \"http://10.132.0.28:28080/metrics\": read tcp 10.132.0.2:41454->10.132.0.28:28080: read: connection reset by peer" Sep 07 12:19:25.518275 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:25.518250 2577 generic.go:356] "Generic (PLEG): container finished" podID="3ed3ab74-3323-494e-9a2f-e38489b15d15" containerID="12c4d18ee9c41cffb6f909ff7af69da70081076f56735419f78d96e786f26f31" exitCode=0 Sep 07 12:19:25.518400 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:25.518337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" event={"ID":"3ed3ab74-3323-494e-9a2f-e38489b15d15","Type":"ContainerDied","Data":"12c4d18ee9c41cffb6f909ff7af69da70081076f56735419f78d96e786f26f31"} Sep 07 12:19:26.670324 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:26.670300 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:19:26.773000 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:26.772969 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg9t6\" (UniqueName: \"kubernetes.io/projected/3ed3ab74-3323-494e-9a2f-e38489b15d15-kube-api-access-cg9t6\") pod \"3ed3ab74-3323-494e-9a2f-e38489b15d15\" (UID: \"3ed3ab74-3323-494e-9a2f-e38489b15d15\") " Sep 07 12:19:26.775160 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:26.775097 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ed3ab74-3323-494e-9a2f-e38489b15d15-kube-api-access-cg9t6" (OuterVolumeSpecName: "kube-api-access-cg9t6") pod "3ed3ab74-3323-494e-9a2f-e38489b15d15" (UID: "3ed3ab74-3323-494e-9a2f-e38489b15d15"). InnerVolumeSpecName "kube-api-access-cg9t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:19:26.874044 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:26.874020 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg9t6\" (UniqueName: \"kubernetes.io/projected/3ed3ab74-3323-494e-9a2f-e38489b15d15-kube-api-access-cg9t6\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:19:27.528753 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:27.528723 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" Sep 07 12:19:27.528753 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:27.528741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm" event={"ID":"3ed3ab74-3323-494e-9a2f-e38489b15d15","Type":"ContainerDied","Data":"144e9d1af6c88db65006b527751ae279d965b5aafb04cd58ba77ea4854d630a6"} Sep 07 12:19:27.529042 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:27.528780 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="144e9d1af6c88db65006b527751ae279d965b5aafb04cd58ba77ea4854d630a6" Sep 07 12:19:28.005453 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.005419 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr"] Sep 07 12:19:28.005816 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.005774 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed3ab74-3323-494e-9a2f-e38489b15d15" containerName="node" Sep 07 12:19:28.005816 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.005789 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed3ab74-3323-494e-9a2f-e38489b15d15" containerName="node" Sep 07 12:19:28.005886 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.005845 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed3ab74-3323-494e-9a2f-e38489b15d15" containerName="node" Sep 07 12:19:28.019163 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.019133 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:19:28.028289 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.028261 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr"] Sep 07 12:19:28.028411 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.028364 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:28.030898 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.030877 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-v84t8\"/\"openshift-service-ca.crt\"" Sep 07 12:19:28.031035 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.030918 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-v84t8\"/\"kube-root-ca.crt\"" Sep 07 12:19:28.031035 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.030960 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-v84t8\"/\"default-dockercfg-997p2\"" Sep 07 12:19:28.083106 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.083079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6fpv\" (UniqueName: \"kubernetes.io/projected/e661580e-94f3-41df-ba63-248830d73499-kube-api-access-z6fpv\") pod \"progression-disabled-node-0-0-4k8pr\" (UID: \"e661580e-94f3-41df-ba63-248830d73499\") " pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:28.183530 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.183506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6fpv\" (UniqueName: \"kubernetes.io/projected/e661580e-94f3-41df-ba63-248830d73499-kube-api-access-z6fpv\") pod \"progression-disabled-node-0-0-4k8pr\" (UID: \"e661580e-94f3-41df-ba63-248830d73499\") " pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:28.191385 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.191363 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6fpv\" (UniqueName: \"kubernetes.io/projected/e661580e-94f3-41df-ba63-248830d73499-kube-api-access-z6fpv\") pod \"progression-disabled-node-0-0-4k8pr\" (UID: \"e661580e-94f3-41df-ba63-248830d73499\") " pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:28.337980 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.337936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:28.627335 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:28.627272 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr"] Sep 07 12:19:28.629637 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:19:28.629605 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode661580e_94f3_41df_ba63_248830d73499.slice/crio-e4ea7590febd22a26410ca5fa5b63555d193c0fb54c31a69e1aea1f2fe5e5682 WatchSource:0}: Error finding container e4ea7590febd22a26410ca5fa5b63555d193c0fb54c31a69e1aea1f2fe5e5682: Status 404 returned error can't find the container with id e4ea7590febd22a26410ca5fa5b63555d193c0fb54c31a69e1aea1f2fe5e5682 Sep 07 12:19:29.539588 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:29.539552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" event={"ID":"e661580e-94f3-41df-ba63-248830d73499","Type":"ContainerStarted","Data":"167e51311c55886c730dd46d7e09bc36588ca20f7fc558f5062b8236ad541518"} Sep 07 12:19:29.540096 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:29.539603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" event={"ID":"e661580e-94f3-41df-ba63-248830d73499","Type":"ContainerStarted","Data":"e4ea7590febd22a26410ca5fa5b63555d193c0fb54c31a69e1aea1f2fe5e5682"} Sep 07 12:19:29.540096 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:29.539655 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:29.555867 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:29.555825 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" podStartSLOduration=2.5558128719999997 podStartE2EDuration="2.555812872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:19:29.554166702 +0000 UTC m=+570.078583003" watchObservedRunningTime="2026-09-07 12:19:29.555812872 +0000 UTC m=+570.080229163" Sep 07 12:19:30.542779 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:30.542753 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:51.790033 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:51.789992 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" podUID="e661580e-94f3-41df-ba63-248830d73499" containerName="node" probeResult="failure" output="Get \"http://10.132.0.29:28080/metrics\": read tcp 10.132.0.2:59734->10.132.0.29:28080: read: connection reset by peer" Sep 07 12:19:52.540990 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:52.540929 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" podUID="e661580e-94f3-41df-ba63-248830d73499" containerName="node" probeResult="failure" output="Get \"http://10.132.0.29:28080/metrics\": dial tcp 10.132.0.29:28080: connect: connection refused" Sep 07 12:19:52.541157 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:52.541050 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:52.541600 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:52.541573 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" podUID="e661580e-94f3-41df-ba63-248830d73499" containerName="node" probeResult="failure" output="Get \"http://10.132.0.29:28080/metrics\": dial tcp 10.132.0.29:28080: connect: connection refused" Sep 07 12:19:52.647388 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:52.647354 2577 generic.go:356] "Generic (PLEG): container finished" podID="e661580e-94f3-41df-ba63-248830d73499" containerID="167e51311c55886c730dd46d7e09bc36588ca20f7fc558f5062b8236ad541518" exitCode=0 Sep 07 12:19:52.647388 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:52.647392 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" event={"ID":"e661580e-94f3-41df-ba63-248830d73499","Type":"ContainerDied","Data":"167e51311c55886c730dd46d7e09bc36588ca20f7fc558f5062b8236ad541518"} Sep 07 12:19:53.779769 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:53.779747 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:53.897013 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:53.896989 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6fpv\" (UniqueName: \"kubernetes.io/projected/e661580e-94f3-41df-ba63-248830d73499-kube-api-access-z6fpv\") pod \"e661580e-94f3-41df-ba63-248830d73499\" (UID: \"e661580e-94f3-41df-ba63-248830d73499\") " Sep 07 12:19:53.899110 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:53.899086 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e661580e-94f3-41df-ba63-248830d73499-kube-api-access-z6fpv" (OuterVolumeSpecName: "kube-api-access-z6fpv") pod "e661580e-94f3-41df-ba63-248830d73499" (UID: "e661580e-94f3-41df-ba63-248830d73499"). InnerVolumeSpecName "kube-api-access-z6fpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:19:53.997680 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:53.997644 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6fpv\" (UniqueName: \"kubernetes.io/projected/e661580e-94f3-41df-ba63-248830d73499-kube-api-access-z6fpv\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:19:54.657210 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:54.657174 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" Sep 07 12:19:54.657367 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:54.657168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr" event={"ID":"e661580e-94f3-41df-ba63-248830d73499","Type":"ContainerDied","Data":"e4ea7590febd22a26410ca5fa5b63555d193c0fb54c31a69e1aea1f2fe5e5682"} Sep 07 12:19:54.657367 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:54.657312 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4ea7590febd22a26410ca5fa5b63555d193c0fb54c31a69e1aea1f2fe5e5682" Sep 07 12:19:59.933990 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:59.933964 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/1.log" Sep 07 12:19:59.935715 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:19:59.935697 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/1.log" Sep 07 12:20:02.968867 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.968833 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6"] Sep 07 12:20:02.969341 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.969316 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e661580e-94f3-41df-ba63-248830d73499" containerName="node" Sep 07 12:20:02.969341 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.969334 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e661580e-94f3-41df-ba63-248830d73499" containerName="node" Sep 07 12:20:02.969480 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.969465 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e661580e-94f3-41df-ba63-248830d73499" containerName="node" Sep 07 12:20:02.972598 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.972577 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:02.975009 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.974988 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-v84t8\"/\"default-dockercfg-997p2\"" Sep 07 12:20:02.975119 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.975012 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-v84t8\"/\"openshift-service-ca.crt\"" Sep 07 12:20:02.975896 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.975883 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-v84t8\"/\"kube-root-ca.crt\"" Sep 07 12:20:02.983478 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:02.983456 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6"] Sep 07 12:20:03.006400 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.006369 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:20:03.058520 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.058486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4499\" (UniqueName: \"kubernetes.io/projected/2aa10f89-6346-4021-af53-47aa07086da2-kube-api-access-f4499\") pod \"progression-invalid-node-0-0-d6wq6\" (UID: \"2aa10f89-6346-4021-af53-47aa07086da2\") " pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:03.159293 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.159258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4499\" (UniqueName: \"kubernetes.io/projected/2aa10f89-6346-4021-af53-47aa07086da2-kube-api-access-f4499\") pod \"progression-invalid-node-0-0-d6wq6\" (UID: \"2aa10f89-6346-4021-af53-47aa07086da2\") " pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:03.167693 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.167668 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4499\" (UniqueName: \"kubernetes.io/projected/2aa10f89-6346-4021-af53-47aa07086da2-kube-api-access-f4499\") pod \"progression-invalid-node-0-0-d6wq6\" (UID: \"2aa10f89-6346-4021-af53-47aa07086da2\") " pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:03.281722 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.281640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:03.551175 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.551148 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6"] Sep 07 12:20:03.553038 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:20:03.553013 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa10f89_6346_4021_af53_47aa07086da2.slice/crio-5573db262c57f57a5a51d87b0e229cde5aeba8d798444f07f6e930ccca27d3aa WatchSource:0}: Error finding container 5573db262c57f57a5a51d87b0e229cde5aeba8d798444f07f6e930ccca27d3aa: Status 404 returned error can't find the container with id 5573db262c57f57a5a51d87b0e229cde5aeba8d798444f07f6e930ccca27d3aa Sep 07 12:20:03.705807 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.705757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" event={"ID":"2aa10f89-6346-4021-af53-47aa07086da2","Type":"ContainerStarted","Data":"ec6f588bddbf29a57fe047aa25a314108924081a64c456de5b6cf8e18f49e930"} Sep 07 12:20:03.706018 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.705833 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" event={"ID":"2aa10f89-6346-4021-af53-47aa07086da2","Type":"ContainerStarted","Data":"5573db262c57f57a5a51d87b0e229cde5aeba8d798444f07f6e930ccca27d3aa"} Sep 07 12:20:03.706018 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.705871 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:03.722305 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:03.722246 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" podStartSLOduration=1.722226313 podStartE2EDuration="1.722226313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:20:03.720625997 +0000 UTC m=+604.245042336" watchObservedRunningTime="2026-09-07 12:20:03.722226313 +0000 UTC m=+604.246642604" Sep 07 12:20:05.713268 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:05.713243 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:18.014680 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:18.014624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:20:18.676114 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:18.676067 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:20:26.711051 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:26.711001 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" podUID="2aa10f89-6346-4021-af53-47aa07086da2" containerName="node" probeResult="failure" output="Get \"http://10.132.0.30:28080/metrics\": dial tcp 10.132.0.30:28080: connect: connection refused" Sep 07 12:20:26.810951 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:26.810912 2577 generic.go:356] "Generic (PLEG): container finished" podID="2aa10f89-6346-4021-af53-47aa07086da2" containerID="ec6f588bddbf29a57fe047aa25a314108924081a64c456de5b6cf8e18f49e930" exitCode=0 Sep 07 12:20:26.811088 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:26.810988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" event={"ID":"2aa10f89-6346-4021-af53-47aa07086da2","Type":"ContainerDied","Data":"ec6f588bddbf29a57fe047aa25a314108924081a64c456de5b6cf8e18f49e930"} Sep 07 12:20:27.949379 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:27.949353 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:28.070792 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:28.070718 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4499\" (UniqueName: \"kubernetes.io/projected/2aa10f89-6346-4021-af53-47aa07086da2-kube-api-access-f4499\") pod \"2aa10f89-6346-4021-af53-47aa07086da2\" (UID: \"2aa10f89-6346-4021-af53-47aa07086da2\") " Sep 07 12:20:28.072825 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:28.072803 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aa10f89-6346-4021-af53-47aa07086da2-kube-api-access-f4499" (OuterVolumeSpecName: "kube-api-access-f4499") pod "2aa10f89-6346-4021-af53-47aa07086da2" (UID: "2aa10f89-6346-4021-af53-47aa07086da2"). InnerVolumeSpecName "kube-api-access-f4499". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:20:28.171709 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:28.171677 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4499\" (UniqueName: \"kubernetes.io/projected/2aa10f89-6346-4021-af53-47aa07086da2-kube-api-access-f4499\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:20:28.821953 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:28.821920 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" event={"ID":"2aa10f89-6346-4021-af53-47aa07086da2","Type":"ContainerDied","Data":"5573db262c57f57a5a51d87b0e229cde5aeba8d798444f07f6e930ccca27d3aa"} Sep 07 12:20:28.821953 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:28.821954 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6" Sep 07 12:20:28.822149 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:20:28.821983 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5573db262c57f57a5a51d87b0e229cde5aeba8d798444f07f6e930ccca27d3aa" Sep 07 12:21:10.298921 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:21:10.298883 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:21:10.396412 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:21:10.396383 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:22:18.554160 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.554074 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:22:18.573263 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.573229 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9"] Sep 07 12:22:18.573623 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.573607 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aa10f89-6346-4021-af53-47aa07086da2" containerName="node" Sep 07 12:22:18.573710 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.573625 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa10f89-6346-4021-af53-47aa07086da2" containerName="node" Sep 07 12:22:18.573764 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.573739 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aa10f89-6346-4021-af53-47aa07086da2" containerName="node" Sep 07 12:22:18.576873 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.576855 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" Sep 07 12:22:18.579237 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.579220 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-v84t8\"/\"openshift-service-ca.crt\"" Sep 07 12:22:18.580297 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.580282 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-v84t8\"/\"default-dockercfg-997p2\"" Sep 07 12:22:18.580396 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.580310 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-v84t8\"/\"kube-root-ca.crt\"" Sep 07 12:22:18.586018 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.585998 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9"] Sep 07 12:22:18.675224 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.675191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zgkd\" (UniqueName: \"kubernetes.io/projected/6746d798-4646-4b35-9a3a-511cb9bcd67d-kube-api-access-8zgkd\") pod \"progression-no-metrics-node-0-0-km8v9\" (UID: \"6746d798-4646-4b35-9a3a-511cb9bcd67d\") " pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" Sep 07 12:22:18.776382 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.776350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zgkd\" (UniqueName: \"kubernetes.io/projected/6746d798-4646-4b35-9a3a-511cb9bcd67d-kube-api-access-8zgkd\") pod \"progression-no-metrics-node-0-0-km8v9\" (UID: \"6746d798-4646-4b35-9a3a-511cb9bcd67d\") " pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" Sep 07 12:22:18.784647 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.784618 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zgkd\" (UniqueName: \"kubernetes.io/projected/6746d798-4646-4b35-9a3a-511cb9bcd67d-kube-api-access-8zgkd\") pod \"progression-no-metrics-node-0-0-km8v9\" (UID: \"6746d798-4646-4b35-9a3a-511cb9bcd67d\") " pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" Sep 07 12:22:18.886651 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:18.886629 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" Sep 07 12:22:19.156142 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:19.155885 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9"] Sep 07 12:22:19.158001 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:22:19.157968 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6746d798_4646_4b35_9a3a_511cb9bcd67d.slice/crio-b7cdf596d270c4a3a911ad8238b7c7aeec4b09fc68f0c20a33c738d27b89a4b1 WatchSource:0}: Error finding container b7cdf596d270c4a3a911ad8238b7c7aeec4b09fc68f0c20a33c738d27b89a4b1: Status 404 returned error can't find the container with id b7cdf596d270c4a3a911ad8238b7c7aeec4b09fc68f0c20a33c738d27b89a4b1 Sep 07 12:22:19.320757 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:19.320727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" event={"ID":"6746d798-4646-4b35-9a3a-511cb9bcd67d","Type":"ContainerStarted","Data":"2ebe75f8c20974644f83898a9f4ad76187124dd80d97c2b14907e533ddd3717a"} Sep 07 12:22:19.320886 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:19.320773 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" event={"ID":"6746d798-4646-4b35-9a3a-511cb9bcd67d","Type":"ContainerStarted","Data":"b7cdf596d270c4a3a911ad8238b7c7aeec4b09fc68f0c20a33c738d27b89a4b1"} Sep 07 12:22:19.340841 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:19.340795 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" podStartSLOduration=1.340781136 podStartE2EDuration="1.340781136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:22:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:22:19.339440237 +0000 UTC m=+739.863856541" watchObservedRunningTime="2026-09-07 12:22:19.340781136 +0000 UTC m=+739.865197426" Sep 07 12:22:24.346451 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:24.346417 2577 generic.go:356] "Generic (PLEG): container finished" podID="6746d798-4646-4b35-9a3a-511cb9bcd67d" containerID="2ebe75f8c20974644f83898a9f4ad76187124dd80d97c2b14907e533ddd3717a" exitCode=0 Sep 07 12:22:24.346823 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:24.346493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" event={"ID":"6746d798-4646-4b35-9a3a-511cb9bcd67d","Type":"ContainerDied","Data":"2ebe75f8c20974644f83898a9f4ad76187124dd80d97c2b14907e533ddd3717a"} Sep 07 12:22:25.479768 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:25.479739 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" Sep 07 12:22:25.634710 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:25.634623 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zgkd\" (UniqueName: \"kubernetes.io/projected/6746d798-4646-4b35-9a3a-511cb9bcd67d-kube-api-access-8zgkd\") pod \"6746d798-4646-4b35-9a3a-511cb9bcd67d\" (UID: \"6746d798-4646-4b35-9a3a-511cb9bcd67d\") " Sep 07 12:22:25.636790 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:25.636769 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6746d798-4646-4b35-9a3a-511cb9bcd67d-kube-api-access-8zgkd" (OuterVolumeSpecName: "kube-api-access-8zgkd") pod "6746d798-4646-4b35-9a3a-511cb9bcd67d" (UID: "6746d798-4646-4b35-9a3a-511cb9bcd67d"). InnerVolumeSpecName "kube-api-access-8zgkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:22:25.735403 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:25.735356 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zgkd\" (UniqueName: \"kubernetes.io/projected/6746d798-4646-4b35-9a3a-511cb9bcd67d-kube-api-access-8zgkd\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:22:26.357067 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:26.357031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" event={"ID":"6746d798-4646-4b35-9a3a-511cb9bcd67d","Type":"ContainerDied","Data":"b7cdf596d270c4a3a911ad8238b7c7aeec4b09fc68f0c20a33c738d27b89a4b1"} Sep 07 12:22:26.357067 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:26.357060 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9" Sep 07 12:22:26.357258 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:26.357085 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7cdf596d270c4a3a911ad8238b7c7aeec4b09fc68f0c20a33c738d27b89a4b1" Sep 07 12:22:26.629711 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:26.629624 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:22:27.446697 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.446659 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ljxv7/must-gather-x8c76"] Sep 07 12:22:27.447115 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.447098 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6746d798-4646-4b35-9a3a-511cb9bcd67d" containerName="node" Sep 07 12:22:27.447216 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.447116 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6746d798-4646-4b35-9a3a-511cb9bcd67d" containerName="node" Sep 07 12:22:27.447283 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.447227 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6746d798-4646-4b35-9a3a-511cb9bcd67d" containerName="node" Sep 07 12:22:27.450357 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.450331 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:22:27.452717 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.452697 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ljxv7\"/\"default-dockercfg-gjvtj\"" Sep 07 12:22:27.452833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.452698 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljxv7\"/\"openshift-service-ca.crt\"" Sep 07 12:22:27.452833 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.452698 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljxv7\"/\"kube-root-ca.crt\"" Sep 07 12:22:27.457475 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.457448 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljxv7/must-gather-x8c76"] Sep 07 12:22:27.461780 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.461761 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:22:27.514198 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.514171 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:22:27.550157 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.550138 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf243dbd-31d0-43e2-ba5f-11506c6976b2-must-gather-output\") pod \"must-gather-x8c76\" (UID: \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\") " pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:22:27.550249 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.550205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzb9z\" (UniqueName: \"kubernetes.io/projected/bf243dbd-31d0-43e2-ba5f-11506c6976b2-kube-api-access-rzb9z\") pod \"must-gather-x8c76\" (UID: \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\") " pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:22:27.650865 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.650841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzb9z\" (UniqueName: \"kubernetes.io/projected/bf243dbd-31d0-43e2-ba5f-11506c6976b2-kube-api-access-rzb9z\") pod \"must-gather-x8c76\" (UID: \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\") " pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:22:27.651181 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.650881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf243dbd-31d0-43e2-ba5f-11506c6976b2-must-gather-output\") pod \"must-gather-x8c76\" (UID: \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\") " pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:22:27.651181 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.651152 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf243dbd-31d0-43e2-ba5f-11506c6976b2-must-gather-output\") pod \"must-gather-x8c76\" (UID: \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\") " pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:22:27.659256 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.659236 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzb9z\" (UniqueName: \"kubernetes.io/projected/bf243dbd-31d0-43e2-ba5f-11506c6976b2-kube-api-access-rzb9z\") pod \"must-gather-x8c76\" (UID: \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\") " pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:22:27.761216 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:27.761165 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:22:28.031305 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:28.031283 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljxv7/must-gather-x8c76"] Sep 07 12:22:28.033799 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:22:28.033773 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf243dbd_31d0_43e2_ba5f_11506c6976b2.slice/crio-63157b397c547efdf679461fe42d768283d8802b22f226afec5feedf4630debd WatchSource:0}: Error finding container 63157b397c547efdf679461fe42d768283d8802b22f226afec5feedf4630debd: Status 404 returned error can't find the container with id 63157b397c547efdf679461fe42d768283d8802b22f226afec5feedf4630debd Sep 07 12:22:28.035630 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:28.035615 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 12:22:28.367558 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:28.367529 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljxv7/must-gather-x8c76" event={"ID":"bf243dbd-31d0-43e2-ba5f-11506c6976b2","Type":"ContainerStarted","Data":"63157b397c547efdf679461fe42d768283d8802b22f226afec5feedf4630debd"} Sep 07 12:22:31.617984 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.617907 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr"] Sep 07 12:22:31.623609 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.623583 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-v84t8/progression-disabled-node-0-0-4k8pr"] Sep 07 12:22:31.628349 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.628322 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm"] Sep 07 12:22:31.631827 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.631809 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-v84t8/progression-enabled-node-0-0-hsktm"] Sep 07 12:22:31.637059 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.637037 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6"] Sep 07 12:22:31.639579 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.639558 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-v84t8/progression-invalid-node-0-0-d6wq6"] Sep 07 12:22:31.654989 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.654960 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9"] Sep 07 12:22:31.663557 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.663530 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-v84t8/progression-no-metrics-node-0-0-km8v9"] Sep 07 12:22:31.708239 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.708207 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:22:31.973799 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.973722 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aa10f89-6346-4021-af53-47aa07086da2" path="/var/lib/kubelet/pods/2aa10f89-6346-4021-af53-47aa07086da2/volumes" Sep 07 12:22:31.974158 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.974139 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ed3ab74-3323-494e-9a2f-e38489b15d15" path="/var/lib/kubelet/pods/3ed3ab74-3323-494e-9a2f-e38489b15d15/volumes" Sep 07 12:22:31.974481 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.974465 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6746d798-4646-4b35-9a3a-511cb9bcd67d" path="/var/lib/kubelet/pods/6746d798-4646-4b35-9a3a-511cb9bcd67d/volumes" Sep 07 12:22:31.974780 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:31.974764 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e661580e-94f3-41df-ba63-248830d73499" path="/var/lib/kubelet/pods/e661580e-94f3-41df-ba63-248830d73499/volumes" Sep 07 12:22:34.405490 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:34.405435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljxv7/must-gather-x8c76" event={"ID":"bf243dbd-31d0-43e2-ba5f-11506c6976b2","Type":"ContainerStarted","Data":"f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99"} Sep 07 12:22:35.413831 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:35.413014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljxv7/must-gather-x8c76" event={"ID":"bf243dbd-31d0-43e2-ba5f-11506c6976b2","Type":"ContainerStarted","Data":"df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00"} Sep 07 12:22:35.428699 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:35.428652 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ljxv7/must-gather-x8c76" podStartSLOduration=2.311390157 podStartE2EDuration="8.428632196s" totalImagesPullingTime="6.117242039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:22:35.427249793 +0000 UTC m=+755.951666094" watchObservedRunningTime="2026-09-07 12:22:35.428632196 +0000 UTC m=+755.953048485" Sep 07 12:22:36.987659 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:36.987621 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:22:37.189512 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:37.189479 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:22:37.809015 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:22:37.808974 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:23:17.642500 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:17.642469 2577 generic.go:356] "Generic (PLEG): container finished" podID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerID="f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99" exitCode=0 Sep 07 12:23:17.642884 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:17.642551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljxv7/must-gather-x8c76" event={"ID":"bf243dbd-31d0-43e2-ba5f-11506c6976b2","Type":"ContainerDied","Data":"f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99"} Sep 07 12:23:17.642926 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:17.642907 2577 scope.go:117] "RemoveContainer" containerID="f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99" Sep 07 12:23:18.595363 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:18.595334 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ljxv7_must-gather-x8c76_bf243dbd-31d0-43e2-ba5f-11506c6976b2/gather/0.log" Sep 07 12:23:18.968698 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:18.968615 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:23:19.123680 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:19.123647 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:23:19.177103 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:19.177073 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:23:22.073606 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:22.073527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pv9mz_ddd00b50-9a74-4d9a-a5e8-ce1986cdc942/global-pull-secret-syncer/0.log" Sep 07 12:23:22.160954 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:22.160919 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" Sep 07 12:23:22.253562 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:22.253536 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-190.ec2.internal_9f328a84a0fd2509d73f64d83dcb2186/haproxy/0.log" Sep 07 12:23:23.942731 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:23.942696 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ljxv7/must-gather-x8c76"] Sep 07 12:23:23.943254 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:23.942873 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-ljxv7/must-gather-x8c76" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerName="copy" containerID="cri-o://df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00" gracePeriod=2 Sep 07 12:23:23.945133 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:23:23.945097 2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-x8c76\" is forbidden: User \"system:node:ip-10-0-133-190.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ljxv7\": no relationship found between node 'ip-10-0-133-190.ec2.internal' and this object" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:23:23.947243 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:23.946707 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ljxv7/must-gather-x8c76"] Sep 07 12:23:24.178745 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.178723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ljxv7_must-gather-x8c76_bf243dbd-31d0-43e2-ba5f-11506c6976b2/copy/0.log" Sep 07 12:23:24.181325 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.181309 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:23:24.351150 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.351122 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf243dbd-31d0-43e2-ba5f-11506c6976b2-must-gather-output\") pod \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\" (UID: \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\") " Sep 07 12:23:24.351323 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.351179 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzb9z\" (UniqueName: \"kubernetes.io/projected/bf243dbd-31d0-43e2-ba5f-11506c6976b2-kube-api-access-rzb9z\") pod \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\" (UID: \"bf243dbd-31d0-43e2-ba5f-11506c6976b2\") " Sep 07 12:23:24.352483 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.352453 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf243dbd-31d0-43e2-ba5f-11506c6976b2-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "bf243dbd-31d0-43e2-ba5f-11506c6976b2" (UID: "bf243dbd-31d0-43e2-ba5f-11506c6976b2"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 12:23:24.353527 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.353493 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf243dbd-31d0-43e2-ba5f-11506c6976b2-kube-api-access-rzb9z" (OuterVolumeSpecName: "kube-api-access-rzb9z") pod "bf243dbd-31d0-43e2-ba5f-11506c6976b2" (UID: "bf243dbd-31d0-43e2-ba5f-11506c6976b2"). InnerVolumeSpecName "kube-api-access-rzb9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 12:23:24.452041 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.452014 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzb9z\" (UniqueName: \"kubernetes.io/projected/bf243dbd-31d0-43e2-ba5f-11506c6976b2-kube-api-access-rzb9z\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:23:24.452041 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.452035 2577 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bf243dbd-31d0-43e2-ba5f-11506c6976b2-must-gather-output\") on node \"ip-10-0-133-190.ec2.internal\" DevicePath \"\"" Sep 07 12:23:24.476869 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.476835 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:23:24.530899 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.530840 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cg7lx_886d8775-2c32-4337-95fb-20ee0e597b87/konnectivity-agent/0.log" limit=1024 Sep 07 12:23:24.676492 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.676420 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ljxv7_must-gather-x8c76_bf243dbd-31d0-43e2-ba5f-11506c6976b2/copy/0.log" Sep 07 12:23:24.676784 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.676763 2577 generic.go:356] "Generic (PLEG): container finished" podID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerID="df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00" exitCode=143 Sep 07 12:23:24.676867 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.676808 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljxv7/must-gather-x8c76" Sep 07 12:23:24.676927 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.676870 2577 scope.go:117] "RemoveContainer" containerID="df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00" Sep 07 12:23:24.685764 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.685748 2577 scope.go:117] "RemoveContainer" containerID="f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99" Sep 07 12:23:24.699277 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.699259 2577 scope.go:117] "RemoveContainer" containerID="df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00" Sep 07 12:23:24.699587 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:23:24.699570 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00\": container with ID starting with df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00 not found: ID does not exist" containerID="df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00" Sep 07 12:23:24.699643 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.699593 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00"} err="failed to get container status \"df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00\": rpc error: code = NotFound desc = could not find container \"df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00\": container with ID starting with df346a3e3e98cd0922a4a463233a18c9c668721156a87cc8ffafc936a7209f00 not found: ID does not exist" Sep 07 12:23:24.699643 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.699610 2577 scope.go:117] "RemoveContainer" containerID="f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99" Sep 07 12:23:24.699862 ip-10-0-133-190 kubenswrapper[2577]: E0907 12:23:24.699844 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99\": container with ID starting with f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99 not found: ID does not exist" containerID="f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99" Sep 07 12:23:24.699909 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:24.699873 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99"} err="failed to get container status \"f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99\": rpc error: code = NotFound desc = could not find container \"f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99\": container with ID starting with f1dae5f404b160cfc812bdfe6d2ee19f24c6e3c9eef4c50aacc5c26e61566b99 not found: ID does not exist" Sep 07 12:23:25.973494 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:25.973461 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" path="/var/lib/kubelet/pods/bf243dbd-31d0-43e2-ba5f-11506c6976b2/volumes" Sep 07 12:23:26.066061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.066040 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f322b12-26fd-45b1-ad13-e4e585488fe3/alertmanager/0.log" Sep 07 12:23:26.086374 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.086349 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f322b12-26fd-45b1-ad13-e4e585488fe3/config-reloader/0.log" Sep 07 12:23:26.108749 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.108708 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f322b12-26fd-45b1-ad13-e4e585488fe3/kube-rbac-proxy-web/0.log" Sep 07 12:23:26.133051 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.133030 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f322b12-26fd-45b1-ad13-e4e585488fe3/kube-rbac-proxy/0.log" Sep 07 12:23:26.161460 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.161439 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f322b12-26fd-45b1-ad13-e4e585488fe3/kube-rbac-proxy-metric/0.log" Sep 07 12:23:26.187120 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.187104 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f322b12-26fd-45b1-ad13-e4e585488fe3/prom-label-proxy/0.log" Sep 07 12:23:26.206426 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.206409 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f322b12-26fd-45b1-ad13-e4e585488fe3/init-config-reloader/0.log" Sep 07 12:23:26.247157 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.247098 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-8tclq_f0e801c3-29d2-4551-afa1-cac8f60ab159/cluster-monitoring-operator/0.log" Sep 07 12:23:26.272088 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.272066 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-7kmvv_c6061a7f-eea8-4a41-aec0-d8fb6650c98f/kube-state-metrics/0.log" Sep 07 12:23:26.289025 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.289007 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-7kmvv_c6061a7f-eea8-4a41-aec0-d8fb6650c98f/kube-rbac-proxy-main/0.log" Sep 07 12:23:26.312728 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.312713 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-7kmvv_c6061a7f-eea8-4a41-aec0-d8fb6650c98f/kube-rbac-proxy-self/0.log" Sep 07 12:23:26.367870 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.367848 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-6c297_fd0dff7a-b736-404d-b9d9-e8cd1d164f76/monitoring-plugin/0.log" Sep 07 12:23:26.401732 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.401696 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wm26_2ababad5-a76f-4d52-970d-f063e0aea7d1/node-exporter/0.log" Sep 07 12:23:26.423806 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.423789 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wm26_2ababad5-a76f-4d52-970d-f063e0aea7d1/kube-rbac-proxy/0.log" Sep 07 12:23:26.445575 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.445559 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wm26_2ababad5-a76f-4d52-970d-f063e0aea7d1/init-textfile/0.log" Sep 07 12:23:26.620687 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.620666 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-42xh8_13e04c77-e4b9-4117-a0ea-4184cf84312c/kube-rbac-proxy-main/0.log" Sep 07 12:23:26.639219 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.639201 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-42xh8_13e04c77-e4b9-4117-a0ea-4184cf84312c/kube-rbac-proxy-self/0.log" Sep 07 12:23:26.657456 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.657432 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-42xh8_13e04c77-e4b9-4117-a0ea-4184cf84312c/openshift-state-metrics/0.log" Sep 07 12:23:26.708576 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.708547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ff498a6-5378-4113-a902-db1e88dff5d4/prometheus/0.log" Sep 07 12:23:26.727394 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.727367 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ff498a6-5378-4113-a902-db1e88dff5d4/config-reloader/0.log" Sep 07 12:23:26.750925 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.750901 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ff498a6-5378-4113-a902-db1e88dff5d4/thanos-sidecar/0.log" Sep 07 12:23:26.770082 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.770059 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ff498a6-5378-4113-a902-db1e88dff5d4/kube-rbac-proxy-web/0.log" Sep 07 12:23:26.789424 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.789406 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ff498a6-5378-4113-a902-db1e88dff5d4/kube-rbac-proxy/0.log" Sep 07 12:23:26.808819 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.808792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ff498a6-5378-4113-a902-db1e88dff5d4/kube-rbac-proxy-thanos/0.log" Sep 07 12:23:26.830771 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:26.830755 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7ff498a6-5378-4113-a902-db1e88dff5d4/init-config-reloader/0.log" Sep 07 12:23:28.404571 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:28.404540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-tj2gj_2cf7c2d9-0396-4849-b25d-621ed1675bc7/networking-console-plugin/0.log" Sep 07 12:23:28.843610 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:28.843582 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/1.log" Sep 07 12:23:28.852078 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:28.852054 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-xk7vd_3f6383ab-9e3a-44b1-aa58-06f0471b9cac/console-operator/2.log" Sep 07 12:23:29.705271 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.705247 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-d5pg8_c2b86631-a821-4d90-a42f-f18edd0e74a1/volume-data-source-validator/0.log" Sep 07 12:23:29.828996 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.828961 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd"] Sep 07 12:23:29.829326 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.829314 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerName="copy" Sep 07 12:23:29.829370 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.829328 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerName="copy" Sep 07 12:23:29.829370 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.829344 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerName="gather" Sep 07 12:23:29.829370 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.829349 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerName="gather" Sep 07 12:23:29.829467 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.829411 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerName="gather" Sep 07 12:23:29.829467 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.829419 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf243dbd-31d0-43e2-ba5f-11506c6976b2" containerName="copy" Sep 07 12:23:29.832492 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.832476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:29.834786 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.834762 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zhp6q\"/\"openshift-service-ca.crt\"" Sep 07 12:23:29.835727 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.835704 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zhp6q\"/\"kube-root-ca.crt\"" Sep 07 12:23:29.835842 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.835704 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zhp6q\"/\"default-dockercfg-x5685\"" Sep 07 12:23:29.839593 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:29.839328 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd"] Sep 07 12:23:30.005969 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.005871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-podres\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.005969 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.005903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8v8k\" (UniqueName: \"kubernetes.io/projected/5754abca-280d-4c7a-b51d-e10d18736d73-kube-api-access-v8v8k\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.005969 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.005925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-proc\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.005969 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.005961 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-lib-modules\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.006235 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.006022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-sys\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107266 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-podres\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107266 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8v8k\" (UniqueName: \"kubernetes.io/projected/5754abca-280d-4c7a-b51d-e10d18736d73-kube-api-access-v8v8k\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107524 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-proc\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107524 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-lib-modules\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107524 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-sys\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107524 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107392 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-proc\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107524 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107413 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-podres\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107524 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107418 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-sys\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.107524 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.107490 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5754abca-280d-4c7a-b51d-e10d18736d73-lib-modules\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.115061 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.115038 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8v8k\" (UniqueName: \"kubernetes.io/projected/5754abca-280d-4c7a-b51d-e10d18736d73-kube-api-access-v8v8k\") pod \"perf-node-gather-daemonset-mv7hd\" (UID: \"5754abca-280d-4c7a-b51d-e10d18736d73\") " pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.143673 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.143645 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.415410 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.415389 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd"] Sep 07 12:23:30.417563 ip-10-0-133-190 kubenswrapper[2577]: W0907 12:23:30.417532 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5754abca_280d_4c7a_b51d_e10d18736d73.slice/crio-07b45db2e18bb7e50621b2591616004063194e13c208f6fdcc2bc4e068c45633 WatchSource:0}: Error finding container 07b45db2e18bb7e50621b2591616004063194e13c208f6fdcc2bc4e068c45633: Status 404 returned error can't find the container with id 07b45db2e18bb7e50621b2591616004063194e13c208f6fdcc2bc4e068c45633 Sep 07 12:23:30.533818 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.533792 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-swgj9_edba9693-13c0-408d-b381-480e11ba4afb/dns/0.log" Sep 07 12:23:30.550791 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.550768 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-swgj9_edba9693-13c0-408d-b381-480e11ba4afb/kube-rbac-proxy/0.log" Sep 07 12:23:30.652317 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.652296 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nd9tt_36018ab5-d35b-4664-8270-178d1220665c/dns-node-resolver/0.log" Sep 07 12:23:30.709034 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.708926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" event={"ID":"5754abca-280d-4c7a-b51d-e10d18736d73","Type":"ContainerStarted","Data":"8f662186c9b32c7092b901fe87f8a8be9e53cccde9017e21c04a38471b0af956"} Sep 07 12:23:30.709034 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.709011 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" event={"ID":"5754abca-280d-4c7a-b51d-e10d18736d73","Type":"ContainerStarted","Data":"07b45db2e18bb7e50621b2591616004063194e13c208f6fdcc2bc4e068c45633"} Sep 07 12:23:30.709416 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.709054 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:30.723459 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:30.723417 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" podStartSLOduration=1.72340347 podStartE2EDuration="1.72340347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:23:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:23:30.722650623 +0000 UTC m=+811.247066936" watchObservedRunningTime="2026-09-07 12:23:30.72340347 +0000 UTC m=+811.247819770" Sep 07 12:23:31.073296 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:31.073220 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxjwz_5281b9b2-ab6e-4a02-877b-e9ebe79f8d83/node-ca/0.log" Sep 07 12:23:31.687374 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:31.687330 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68fb9cd898-bzvx4_68e5dd72-77d2-40c3-94ea-f99bb3dc3387/router/0.log" Sep 07 12:23:32.003679 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:32.003605 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-27274_6e9e4432-71ac-4a2d-bef4-0f4de3102334/serve-healthcheck-canary/0.log" Sep 07 12:23:32.396204 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:32.396158 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-msfcx_7795859b-24f2-497c-ad22-f6f64ee052b1/insights-operator/1.log" Sep 07 12:23:32.396581 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:32.396557 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-msfcx_7795859b-24f2-497c-ad22-f6f64ee052b1/insights-operator/0.log" Sep 07 12:23:32.414448 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:32.414416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmb5f_87b0147c-1cfb-4c8b-869f-e6bf155e0971/kube-rbac-proxy/0.log" Sep 07 12:23:32.432546 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:32.432526 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmb5f_87b0147c-1cfb-4c8b-869f-e6bf155e0971/exporter/0.log" Sep 07 12:23:32.450952 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:32.450928 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmb5f_87b0147c-1cfb-4c8b-869f-e6bf155e0971/extractor/0.log" Sep 07 12:23:36.723406 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:36.723376 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zhp6q/perf-node-gather-daemonset-mv7hd" Sep 07 12:23:37.350882 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:37.350853 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-rsfhf_2c27082b-d48c-45e2-8e89-b2e437457038/kube-storage-version-migrator-operator/1.log" Sep 07 12:23:37.352445 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:37.352422 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-rsfhf_2c27082b-d48c-45e2-8e89-b2e437457038/kube-storage-version-migrator-operator/0.log" Sep 07 12:23:38.378891 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.378867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkvs9_e83a29fa-0986-450f-b369-6b4f79e109ff/kube-multus-additional-cni-plugins/0.log" Sep 07 12:23:38.398891 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.398821 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkvs9_e83a29fa-0986-450f-b369-6b4f79e109ff/egress-router-binary-copy/0.log" Sep 07 12:23:38.420509 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.420488 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkvs9_e83a29fa-0986-450f-b369-6b4f79e109ff/cni-plugins/0.log" Sep 07 12:23:38.441905 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.441881 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkvs9_e83a29fa-0986-450f-b369-6b4f79e109ff/bond-cni-plugin/0.log" Sep 07 12:23:38.464683 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.464655 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkvs9_e83a29fa-0986-450f-b369-6b4f79e109ff/routeoverride-cni/0.log" Sep 07 12:23:38.485310 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.485291 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkvs9_e83a29fa-0986-450f-b369-6b4f79e109ff/whereabouts-cni-bincopy/0.log" Sep 07 12:23:38.507827 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.507806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rkvs9_e83a29fa-0986-450f-b369-6b4f79e109ff/whereabouts-cni/0.log" Sep 07 12:23:38.727289 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.727217 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v4r6m_c1529f38-3198-4669-88fc-bceae306e488/kube-multus/0.log" Sep 07 12:23:38.795746 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.795721 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7mjbg_524bf8ca-1381-4b45-9dd4-c4b00152a215/network-metrics-daemon/0.log" Sep 07 12:23:38.816096 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:38.816071 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7mjbg_524bf8ca-1381-4b45-9dd4-c4b00152a215/kube-rbac-proxy/0.log" Sep 07 12:23:39.674454 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:39.674373 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92kzn_3a252e78-2d91-4150-a5cf-ada5362e9ec2/ovn-controller/0.log" Sep 07 12:23:39.688003 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:39.687981 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92kzn_3a252e78-2d91-4150-a5cf-ada5362e9ec2/ovn-acl-logging/0.log" Sep 07 12:23:39.709712 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:39.709684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92kzn_3a252e78-2d91-4150-a5cf-ada5362e9ec2/kube-rbac-proxy-node/0.log" Sep 07 12:23:39.728807 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:39.728782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92kzn_3a252e78-2d91-4150-a5cf-ada5362e9ec2/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 12:23:39.744396 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:39.744376 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92kzn_3a252e78-2d91-4150-a5cf-ada5362e9ec2/northd/0.log" Sep 07 12:23:39.763389 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:39.763375 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92kzn_3a252e78-2d91-4150-a5cf-ada5362e9ec2/nbdb/0.log" Sep 07 12:23:39.781831 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:39.781811 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92kzn_3a252e78-2d91-4150-a5cf-ada5362e9ec2/sbdb/0.log" Sep 07 12:23:39.831096 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:39.831066 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-92kzn_3a252e78-2d91-4150-a5cf-ada5362e9ec2/ovnkube-controller/0.log" Sep 07 12:23:41.206399 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:41.206368 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-qhfdn_ec7ce58e-24ce-45ac-98d6-86225913cc76/check-endpoints/0.log" Sep 07 12:23:41.248375 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:41.248292 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gxclc_41c98bc0-8d70-4f48-9b70-7fd4287e3ee8/network-check-target-container/0.log" Sep 07 12:23:42.076444 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:42.076418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nvvg7_4edcc1b8-b6f4-4b01-a525-6b939f477ca3/iptables-alerter/0.log" Sep 07 12:23:42.690506 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:42.690479 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-545kx_f0e6aaeb-d135-47e8-9580-adbc6aebce18/tuned/0.log" Sep 07 12:23:44.293330 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:44.293305 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-2zpn8_f949622d-8482-4580-b561-903730060a47/cluster-samples-operator/0.log" Sep 07 12:23:44.308094 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:44.308065 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-2zpn8_f949622d-8482-4580-b561-903730060a47/cluster-samples-operator-watch/0.log" Sep 07 12:23:45.167398 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:45.167373 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-dmq2j_95e7ce93-4012-4f95-8c8f-f0949b031ca9/service-ca-operator/1.log" Sep 07 12:23:45.169118 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:45.169096 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-dmq2j_95e7ce93-4012-4f95-8c8f-f0949b031ca9/service-ca-operator/0.log" Sep 07 12:23:45.837724 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:45.837696 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-5g2zg_b253bb79-6c39-4bb2-9dbd-9826b18a83a4/csi-driver/0.log" Sep 07 12:23:45.861381 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:45.861344 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-5g2zg_b253bb79-6c39-4bb2-9dbd-9826b18a83a4/csi-node-driver-registrar/0.log" Sep 07 12:23:45.879424 ip-10-0-133-190 kubenswrapper[2577]: I0907 12:23:45.879399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-5g2zg_b253bb79-6c39-4bb2-9dbd-9826b18a83a4/csi-liveness-probe/0.log"