Sep 18 21:50:41.450046 ip-10-0-143-133 systemd[1]: Starting Kubernetes Kubelet... Sep 18 21:50:44.974909 ip-10-0-143-133 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:50:44.974909 ip-10-0-143-133 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 21:50:44.974909 ip-10-0-143-133 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:50:44.974909 ip-10-0-143-133 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 21:50:44.974909 ip-10-0-143-133 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 21:50:44.975783 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.974984 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 21:50:44.979075 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979057 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:44.979075 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979074 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979078 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979083 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979087 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979090 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979093 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979096 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979100 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979105 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979109 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979112 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979115 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979118 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979121 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979124 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979127 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979130 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979133 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979136 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979139 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:44.979144 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979151 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979155 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979158 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979161 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979164 2553 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979168 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979173 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979176 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979179 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979181 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979184 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979188 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979191 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979193 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979196 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979199 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979202 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979205 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979207 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979210 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:44.979696 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979213 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979216 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979218 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979221 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979224 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979226 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979229 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979232 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979234 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979237 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979240 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979243 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979245 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979251 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979254 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979258 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979261 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979264 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979266 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:44.980539 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979269 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979272 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979275 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979277 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979280 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979283 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979286 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979289 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979291 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979294 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979297 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979299 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979303 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979305 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979308 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979310 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979314 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979318 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979321 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:44.981314 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979324 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979327 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979330 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979333 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979336 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979338 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979341 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979344 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979349 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979352 2553 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979355 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979357 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979360 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979363 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979366 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979368 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979371 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979373 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979376 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.979379 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:44.982031 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981162 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981666 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981846 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981851 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981855 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981858 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981864 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981867 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981871 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981874 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981877 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981881 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981884 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981887 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981890 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981893 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981896 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981900 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981903 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981905 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:44.982558 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981908 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981912 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981914 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981917 2553 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981920 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981923 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981926 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981929 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981932 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981935 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981942 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981946 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981949 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981952 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981959 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981962 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981964 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981967 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981971 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981974 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:44.983128 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981976 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981979 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981982 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981985 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981988 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981991 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981996 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.981999 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982002 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982005 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982009 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982012 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982014 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982017 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982020 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982023 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982027 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982032 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982037 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:44.983666 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982042 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982046 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982049 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982053 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982055 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982058 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982061 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982066 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982070 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982075 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982080 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982083 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982086 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982089 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982092 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982095 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982098 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982101 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982103 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:44.984204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982106 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982109 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982111 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982114 2553 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982117 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982120 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982123 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982126 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982129 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982132 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982135 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982137 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982140 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982143 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982145 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982148 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982151 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982154 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982157 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982160 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:44.984723 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982165 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982590 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982596 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982600 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982603 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982606 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982609 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982612 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982616 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982620 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982624 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982628 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982631 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982635 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982638 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982641 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982644 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982647 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982650 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:44.985273 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982654 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982657 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982660 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982663 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982665 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982668 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982671 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982673 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982676 2553 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982679 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982683 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982686 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982688 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982693 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982696 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982699 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982702 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982705 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982707 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982710 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:44.985803 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982713 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982716 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982718 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982721 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982723 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982726 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982729 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982731 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982734 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982737 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982739 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982758 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982762 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982765 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982767 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982770 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982773 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982775 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982778 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:44.986322 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982781 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982783 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982786 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982789 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982792 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982795 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982800 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982803 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982805 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982808 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982811 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982814 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982817 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982820 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982822 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982826 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982828 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982831 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982834 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982836 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:44.986821 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982839 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982843 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982845 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982848 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982851 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982855 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982858 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982861 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982864 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982866 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982869 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982872 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982875 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982877 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982880 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982883 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982886 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982889 2553 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982895 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:44.987384 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982898 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982902 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.982905 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.982991 2553 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983030 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983037 2553 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983042 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983047 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983051 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983055 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983060 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983064 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983067 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983071 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983075 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983078 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983081 2553 flags.go:64] FLAG: --cgroup-root="" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983085 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983088 2553 flags.go:64] FLAG: --client-ca-file="" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983092 2553 flags.go:64] FLAG: --cloud-provider="external" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983095 2553 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983101 2553 flags.go:64] FLAG: --cluster-domain="" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983104 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 21:50:44.987896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983108 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983111 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983115 2553 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983119 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983123 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983126 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983130 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983133 2553 flags.go:64] FLAG: --contention-profiling="false" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983138 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983142 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983145 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983149 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983153 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983156 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983160 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983163 2553 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983166 2553 flags.go:64] FLAG: --enable-server="true" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983169 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983174 2553 flags.go:64] FLAG: --event-burst="100" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983178 2553 flags.go:64] FLAG: --event-qps="50" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983181 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983184 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983188 2553 flags.go:64] FLAG: --eviction-hard="" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983192 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 21:50:44.988494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983195 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983198 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983202 2553 flags.go:64] FLAG: --eviction-soft="" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983205 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983208 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983212 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983215 2553 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983219 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983222 2553 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983225 2553 flags.go:64] FLAG: --feature-gates="" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983229 2553 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983232 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983235 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983243 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983246 2553 flags.go:64] FLAG: --healthz-port="10248" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983249 2553 flags.go:64] FLAG: --help="false" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983253 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-143-133.ec2.internal" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983257 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983260 2553 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983264 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983268 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983272 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983275 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 21:50:44.989126 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983279 2553 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983282 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983285 2553 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983288 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983292 2553 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983295 2553 flags.go:64] FLAG: --kube-reserved="" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983298 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983301 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983304 2553 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983307 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983311 2553 flags.go:64] FLAG: --lock-file="" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983314 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983317 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983320 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983331 2553 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983335 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983338 2553 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983341 2553 flags.go:64] FLAG: --logging-format="text" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983344 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983348 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983351 2553 flags.go:64] FLAG: --manifest-url="" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983354 2553 flags.go:64] FLAG: --manifest-url-header="" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983360 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983363 2553 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983368 2553 flags.go:64] FLAG: --max-pods="110" Sep 18 21:50:44.989800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983372 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983375 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983378 2553 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983382 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983385 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983389 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983392 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983400 2553 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983403 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983407 2553 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983410 2553 flags.go:64] FLAG: --pod-cidr="" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983413 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983419 2553 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983423 2553 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983426 2553 flags.go:64] FLAG: --pods-per-core="0" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983429 2553 flags.go:64] FLAG: --port="10250" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983433 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983436 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f1f00f7a13a1f066" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983440 2553 flags.go:64] FLAG: --qos-reserved="" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983443 2553 flags.go:64] FLAG: --read-only-port="10255" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983446 2553 flags.go:64] FLAG: --register-node="true" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983449 2553 flags.go:64] FLAG: --register-with-taints="" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983453 2553 flags.go:64] FLAG: --registry-burst="10" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983457 2553 flags.go:64] FLAG: --registry-qps="5" Sep 18 21:50:44.990494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983461 2553 flags.go:64] FLAG: --reserved-cpus="" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983464 2553 flags.go:64] FLAG: --reserved-memory="" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983468 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983471 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983475 2553 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983478 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983483 2553 flags.go:64] FLAG: --runonce="false" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983486 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983489 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983493 2553 flags.go:64] FLAG: --seccomp-default="false" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983496 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983499 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983502 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983506 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983510 2553 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983513 2553 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983516 2553 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983519 2553 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983523 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983526 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983530 2553 flags.go:64] FLAG: --system-cgroups="" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983533 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983539 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983542 2553 flags.go:64] FLAG: --tls-cert-file="" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983545 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 21:50:44.991180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983550 2553 flags.go:64] FLAG: --tls-min-version="" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983553 2553 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983556 2553 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983559 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983562 2553 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983566 2553 flags.go:64] FLAG: --v="2" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983570 2553 flags.go:64] FLAG: --version="false" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983575 2553 flags.go:64] FLAG: --vmodule="" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983579 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.983582 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983699 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983702 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983705 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983711 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983713 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983716 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983719 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983724 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983728 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983731 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983734 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983752 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:44.991850 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983755 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983758 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983762 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983765 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983768 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983771 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983774 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983777 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983781 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983783 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983787 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983790 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983793 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983796 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983798 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983801 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983804 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983810 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983814 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:44.992418 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983818 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983821 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983824 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983827 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983832 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983835 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983838 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983842 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983845 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983848 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983851 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983854 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983858 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983861 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983863 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983867 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983870 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983873 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983875 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983879 2553 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:44.992934 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983881 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983885 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983887 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983890 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983893 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983896 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983899 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983902 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983904 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983907 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983912 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983915 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983919 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983921 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983924 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983927 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983931 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983934 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983937 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983939 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:44.993457 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983942 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983946 2553 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983949 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983952 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983954 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983957 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983960 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983963 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983966 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983969 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983972 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983975 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983978 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983981 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983984 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983987 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983990 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983992 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.983996 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984000 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:44.993994 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984003 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984005 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984009 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984037 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984041 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984054 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984058 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.984062 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.984449 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.991774 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.991791 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.991814 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.991820 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991882 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:44.994528 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991888 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991892 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991895 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991899 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991902 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991906 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991909 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991912 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991915 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991918 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991922 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991924 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991928 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991931 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991934 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991937 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991940 2553 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991943 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991945 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991948 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:44.995078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991951 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991954 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991957 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991960 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991963 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991966 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991969 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991972 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991976 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991979 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991983 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991985 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991989 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991991 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991994 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.991997 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992000 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992005 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992009 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:44.995605 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992012 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992016 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992019 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992023 2553 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992026 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992029 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992033 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992037 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992040 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992043 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992045 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992049 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992052 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992055 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992058 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992061 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992064 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992067 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992071 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992075 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:44.996186 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992078 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992082 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992085 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992089 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992092 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992095 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992098 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992100 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992103 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992106 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992109 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992112 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992115 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992118 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992121 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992124 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992127 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992130 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992133 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992136 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:44.996866 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992139 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992142 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992144 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992147 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992150 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992153 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992156 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992159 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992162 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992165 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992168 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992171 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992174 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992177 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992181 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992186 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992189 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992192 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:44.997763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992195 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.992201 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992321 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992327 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992330 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992334 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992337 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992340 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992343 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992346 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992349 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992352 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992354 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992357 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992360 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 21:50:44.998323 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992363 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992366 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992369 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992372 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992375 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992377 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992380 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992383 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992386 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992389 2553 feature_gate.go:328] unrecognized feature gate: Example Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992392 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992394 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992398 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992401 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992404 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992407 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992410 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992413 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992416 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992419 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 21:50:44.998864 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992422 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992425 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992429 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992431 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992434 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992437 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992440 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992443 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992446 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992449 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992451 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992454 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992457 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992460 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992463 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992465 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992468 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992471 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992474 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992477 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 21:50:44.999476 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992479 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992482 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992485 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992488 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992490 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992493 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992496 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992499 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992503 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992506 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992509 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992512 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992514 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992517 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992521 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992523 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992526 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992529 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992533 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 21:50:45.000325 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992537 2553 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992540 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992543 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992546 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992549 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992552 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992555 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992558 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992561 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992564 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992567 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992570 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992573 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992575 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992578 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992581 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992584 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992587 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992591 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 21:50:45.000878 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992594 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992598 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992601 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992604 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992607 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992610 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992613 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:44.992616 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.992621 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.992758 2553 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.994804 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.995728 2553 server.go:1019] "Starting client certificate rotation" Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.995871 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 21:50:45.001555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.996548 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 21:50:45.002365 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.997938 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 21:50:45.002365 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:44.999148 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 21:50:45.004429 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.004404 2553 log.go:25] "Validated CRI v1 runtime API" Sep 18 21:50:45.006488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.006473 2553 log.go:25] "Validated CRI v1 image API" Sep 18 21:50:45.007334 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.007302 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 21:50:45.009470 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.009452 2553 fs.go:135] Filesystem UUIDs: map[3701fa72-be0c-46e6-a4f2-c66e083b0ba0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 98de1c69-db18-4305-83df-1cc715217219:/dev/nvme0n1p3] Sep 18 21:50:45.009532 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.009470 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 21:50:45.014335 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.014219 2553 manager.go:216] Machine: {Timestamp:2026-09-18 21:50:45.01367479 +0000 UTC m=+1.990736329 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102912 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2317829cf12fe0f22957ed36276317 SystemUUID:ec231782-9cf1-2fe0-f229-57ed36276317 BootID:31dd0817-d829-4757-8515-80be945dcb04 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f1:f7:a9:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f1:f7:a9:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:e2:af:4a:ad:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 21:50:45.014335 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.014329 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 21:50:45.014463 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.014451 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 21:50:45.015723 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.015693 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 21:50:45.015884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.015722 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 21:50:45.017193 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.017181 2553 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 21:50:45.017193 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.017194 2553 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 21:50:45.017310 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.017203 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 21:50:45.017310 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.017214 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 21:50:45.018241 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.018226 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 21:50:45.022519 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.022506 2553 state_mem.go:36] "Initialized new in-memory state store" Sep 18 21:50:45.022649 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.022639 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 21:50:45.023099 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.023084 2553 kubelet.go:486] "Attempting to sync node with API server" Sep 18 21:50:45.023153 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.023122 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 21:50:45.031990 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.031976 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 21:50:45.032067 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.031999 2553 kubelet.go:398] "Adding apiserver pod source" Sep 18 21:50:45.032067 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.032010 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 21:50:45.032481 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.032468 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 21:50:45.032535 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.032488 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 21:50:45.034240 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.034221 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 21:50:45.035820 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.035804 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 21:50:45.035892 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.035836 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 21:50:45.037491 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037478 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 21:50:45.037532 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037496 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 21:50:45.037532 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037503 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 21:50:45.037532 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037508 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 21:50:45.037532 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037520 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 21:50:45.037532 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037526 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 21:50:45.037677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037544 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 21:50:45.037677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037550 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 21:50:45.037677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037556 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 21:50:45.037677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037562 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 21:50:45.037677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037577 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 21:50:45.037677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037583 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 21:50:45.037677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037610 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 21:50:45.037677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.037616 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 21:50:45.040779 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.040716 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 21:50:45.040877 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.040758 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 21:50:45.040877 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.040836 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 21:50:45.042015 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.042002 2553 server.go:1268] "Started kubelet" Sep 18 21:50:45.042091 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.042068 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 21:50:45.042204 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.042157 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 21:50:45.042251 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.042237 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 21:50:45.042884 ip-10-0-143-133 systemd[1]: Started Kubernetes Kubelet. Sep 18 21:50:45.073653 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.073625 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 21:50:45.074174 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.074146 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qvhnh" Sep 18 21:50:45.074675 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.074652 2553 server.go:310] "Adding debug handlers to kubelet server" Sep 18 21:50:45.074895 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.074868 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 21:50:45.075711 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.075691 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qvhnh" Sep 18 21:50:45.081395 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.081379 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 21:50:45.081482 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.081398 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 21:50:45.081482 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.081465 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.081635 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.081617 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 21:50:45.082070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.081970 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 21:50:45.082070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082006 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 21:50:45.082070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082064 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 21:50:45.082249 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082149 2553 reconstruct.go:97] "Volume reconstruction finished" Sep 18 21:50:45.082249 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082158 2553 reconciler.go:29] "Reconciler: start to sync state" Sep 18 21:50:45.082572 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.081814 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-133.ec2.internal.18d688bc7c0040c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-133.ec2.internal,UID:ip-10-0-143-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-133.ec2.internal,},FirstTimestamp:2026-09-18 21:50:45.041971399 +0000 UTC m=+2.019032917,LastTimestamp:2026-09-18 21:50:45.041971399 +0000 UTC m=+2.019032917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-133.ec2.internal,}" Sep 18 21:50:45.082670 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082608 2553 factory.go:55] Registering systemd factory Sep 18 21:50:45.082670 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082626 2553 factory.go:223] Registration of the systemd container factory successfully Sep 18 21:50:45.082926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082896 2553 factory.go:153] Registering CRI-O factory Sep 18 21:50:45.082926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082911 2553 factory.go:223] Registration of the crio container factory successfully Sep 18 21:50:45.083028 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082966 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 21:50:45.083028 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082982 2553 factory.go:103] Registering Raw factory Sep 18 21:50:45.083028 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.082993 2553 manager.go:1196] Started watching for new ooms in manager Sep 18 21:50:45.083661 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.083649 2553 manager.go:349] Starting recovery of all containers Sep 18 21:50:45.093093 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.093070 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:45.093824 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.093805 2553 manager.go:354] Recovery completed Sep 18 21:50:45.097940 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.097925 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:45.099971 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.099956 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:45.100038 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.099986 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:45.100038 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.099999 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:45.101412 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.101389 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 21:50:45.101412 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.101411 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 21:50:45.101570 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.101433 2553 state_mem.go:36] "Initialized new in-memory state store" Sep 18 21:50:45.102281 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.102225 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:45.103548 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.103528 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:45.103627 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.103561 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:45.103627 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.103573 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:45.103852 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.103828 2553 policy_none.go:49] "None policy: Start" Sep 18 21:50:45.103897 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.103863 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 21:50:45.103897 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.103882 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 21:50:45.106030 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.106018 2553 policy_none.go:47] "Start" Sep 18 21:50:45.108559 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.108539 2553 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-133.ec2.internal\" not found" node="ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.140625 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.140427 2553 manager.go:337] "Starting Device Plugin manager" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.140658 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.140673 2553 server.go:87] "Starting device plugin registration server" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.140920 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.140939 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.141033 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.141116 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.141126 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.141729 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 21:50:45.155948 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.141777 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.174123 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.174096 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 21:50:45.175445 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.175427 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 21:50:45.175566 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.175486 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 21:50:45.175566 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.175516 2553 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 21:50:45.175656 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.175564 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 21:50:45.179451 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.179433 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:45.243588 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.243500 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:45.244562 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.244542 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:45.244657 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.244574 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:45.244657 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.244588 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:45.244657 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.244619 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.265273 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.265249 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.265358 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.265282 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-133.ec2.internal\": node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.275833 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.275811 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal"] Sep 18 21:50:45.275916 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.275878 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:45.277176 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.277162 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:45.277232 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.277190 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:45.277232 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.277200 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:45.279749 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.279736 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:45.279877 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.279862 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.279916 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.279893 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:45.280510 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.280494 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:45.280585 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.280525 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:45.280585 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.280537 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:45.280585 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.280498 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:45.280679 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.280602 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:45.280679 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.280617 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:45.282987 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.282971 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.283035 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.283007 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 21:50:45.283089 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.282972 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/262678f852fc1002c2fa89bce117a88a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"262678f852fc1002c2fa89bce117a88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.283127 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.283086 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/262678f852fc1002c2fa89bce117a88a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"262678f852fc1002c2fa89bce117a88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.283127 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.283108 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f04635d02a567d20d1ca9921c8ed991-config\") pod \"kube-apiserver-proxy-ip-10-0-143-133.ec2.internal\" (UID: \"5f04635d02a567d20d1ca9921c8ed991\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.283721 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.283703 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientMemory" Sep 18 21:50:45.283843 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.283734 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 21:50:45.283843 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.283761 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeHasSufficientPID" Sep 18 21:50:45.294115 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.294097 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.298301 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.298282 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-133.ec2.internal\" not found" node="ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.301759 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.301728 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-133.ec2.internal\" not found" node="ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.384278 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.384236 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/262678f852fc1002c2fa89bce117a88a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"262678f852fc1002c2fa89bce117a88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.384427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.384289 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f04635d02a567d20d1ca9921c8ed991-config\") pod \"kube-apiserver-proxy-ip-10-0-143-133.ec2.internal\" (UID: \"5f04635d02a567d20d1ca9921c8ed991\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.384427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.384317 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/262678f852fc1002c2fa89bce117a88a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"262678f852fc1002c2fa89bce117a88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.384427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.384310 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/262678f852fc1002c2fa89bce117a88a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"262678f852fc1002c2fa89bce117a88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.384427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.384386 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/262678f852fc1002c2fa89bce117a88a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal\" (UID: \"262678f852fc1002c2fa89bce117a88a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.384427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.384390 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5f04635d02a567d20d1ca9921c8ed991-config\") pod \"kube-apiserver-proxy-ip-10-0-143-133.ec2.internal\" (UID: \"5f04635d02a567d20d1ca9921c8ed991\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.394767 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.394745 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.495899 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.495828 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.596928 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.596900 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.601278 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.601262 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.604794 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.604769 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.697974 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.697936 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.799143 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:45.799066 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-133.ec2.internal\" not found" Sep 18 21:50:45.874245 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.874216 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:45.882484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.882464 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.910467 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.910443 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 21:50:45.912034 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.912017 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" Sep 18 21:50:45.934539 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.934516 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 21:50:45.996097 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.996066 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 21:50:45.996539 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.996224 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 21:50:45.996539 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:45.996263 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 21:50:46.033156 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.033126 2553 apiserver.go:52] "Watching apiserver" Sep 18 21:50:46.044409 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.043942 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 21:50:46.045096 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.045046 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl","openshift-dns/node-resolver-dkbkd","openshift-image-registry/node-ca-kf47m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal","openshift-network-diagnostics/network-check-target-l94mz","openshift-ovn-kubernetes/ovnkube-node-lcc96","kube-system/global-pull-secret-syncer-4wnpc","openshift-cluster-node-tuning-operator/tuned-27xpp","openshift-multus/multus-42npz","openshift-multus/multus-additional-cni-plugins-nsdpg","openshift-multus/network-metrics-daemon-ndv9n","openshift-network-operator/iptables-alerter-l8kp2","kube-system/konnectivity-agent-lh2wh"] Sep 18 21:50:46.047857 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.047837 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.050890 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.050840 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.052852 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.052832 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 21:50:46.053836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.053818 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.056752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.056725 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.058520 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.058501 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 21:50:46.058656 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.058571 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 21:50:46.058656 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.058581 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tcstv\"" Sep 18 21:50:46.058656 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.058573 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 21:50:46.058846 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.058820 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 21:50:46.059097 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.059082 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-scr5g\"" Sep 18 21:50:46.059313 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.059298 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:46.059396 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.059360 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:50:46.059858 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.059841 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 21:50:46.060819 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.060799 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-prrr8\"" Sep 18 21:50:46.060900 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.060841 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 21:50:46.060900 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.060848 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 21:50:46.061536 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.061523 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.062407 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.062390 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 21:50:46.062513 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.062492 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 21:50:46.062555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.062548 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-78br8\"" Sep 18 21:50:46.062596 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.062552 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 21:50:46.062984 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.062966 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:50:46.063239 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.063221 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 21:50:46.063333 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.063319 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 21:50:46.064192 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.064178 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:50:46.067510 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.067492 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.069826 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.069802 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:50:46.069930 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.069913 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q2gsv\"" Sep 18 21:50:46.069988 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.069915 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 21:50:46.070055 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.070039 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 21:50:46.070128 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.070115 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 21:50:46.070194 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.070179 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 21:50:46.070334 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.070314 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 21:50:46.070564 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.070552 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-42npz" Sep 18 21:50:46.070638 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.070626 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2qc9t\"" Sep 18 21:50:46.071517 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.071500 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 21:50:46.073070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.073053 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.073812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.073794 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hm26x\"" Sep 18 21:50:46.074298 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.074285 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 21:50:46.075007 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.074988 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 21:50:46.075605 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.075587 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:46.075682 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.075642 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:50:46.077603 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.077580 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 21:50:46.077709 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.077691 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 21:50:46.077795 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.077730 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 21:50:46.077795 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.077735 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 21:50:46.077795 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.077767 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6bvxx\"" Sep 18 21:50:46.078008 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.077987 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.078083 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.078041 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nhk9k\"" Sep 18 21:50:46.078083 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.078048 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:50:46.080466 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.080406 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 21:45:45 +0000 UTC" deadline="2028-02-24 19:22:28.824853766 +0000 UTC" Sep 18 21:50:46.080466 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.080465 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12573h31m42.744392246s" Sep 18 21:50:46.081649 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.081479 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 21:50:46.082967 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.082951 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089496 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03-konnectivity-ca\") pod \"konnectivity-agent-lh2wh\" (UID: \"9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03\") " pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089550 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-dbus\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089637 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-modprobe-d\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089668 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovn-node-metrics-cert\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089698 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-hostroot\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089857 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qthx\" (UniqueName: \"kubernetes.io/projected/ef2b78c9-2057-4797-849a-d88a0ceccbab-kube-api-access-4qthx\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089892 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-iptables-alerter-script\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089923 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-run-netns\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.089955 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-ovn\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090012 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovnkube-config\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090036 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07c0afd-584c-49f8-a8d0-46497506f2b6-tmp-dir\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090078 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz7c2\" (UniqueName: \"kubernetes.io/projected/e07c0afd-584c-49f8-a8d0-46497506f2b6-kube-api-access-qz7c2\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090107 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-k8s-cni-cncf-io\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090136 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b80f305-7db1-4458-9919-4a956ac98551-host\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090161 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.092071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090206 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-multus-certs\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090254 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysctl-conf\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090315 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-systemd\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090344 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-var-lib-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090373 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-socket-dir-parent\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090426 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090581 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prndw\" (UniqueName: \"kubernetes.io/projected/2de0f77b-b8af-4621-99bb-86b1167904c1-kube-api-access-prndw\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090640 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-kubelet\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090670 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090713 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-cni-bin\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090737 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1074956-ac86-412f-85b2-55a907fdac83-multus-daemon-config\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090785 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffgfw\" (UniqueName: \"kubernetes.io/projected/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-kube-api-access-ffgfw\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090815 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090860 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-systemd-units\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090906 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-cni-multus\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090944 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:46.092800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.090981 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091043 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-env-overrides\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091073 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1074956-ac86-412f-85b2-55a907fdac83-cni-binary-copy\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091134 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091208 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-system-cni-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091261 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-cni-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091398 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-cni-binary-copy\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091456 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxgfp\" (UniqueName: \"kubernetes.io/projected/1200e5c4-bfff-4f92-8664-c786ae2c1395-kube-api-access-lxgfp\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091503 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091550 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-device-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091593 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-cnibin\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091622 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysctl-d\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091679 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03-agent-certs\") pod \"konnectivity-agent-lh2wh\" (UID: \"9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03\") " pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091722 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-etc-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091781 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-log-socket\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091833 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovnkube-script-lib\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.093454 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091879 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e07c0afd-584c-49f8-a8d0-46497506f2b6-hosts-file\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091922 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-systemd\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.091966 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-cni-bin\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.092018 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-cnibin\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.092366 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-netns\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.092457 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-kubelet\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.092853 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-conf-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.092943 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-system-cni-dir\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.092988 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-host-slash\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093051 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-lib-modules\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093114 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-node-log\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093164 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysconfig\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093225 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-run\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093264 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-host\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093318 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1200e5c4-bfff-4f92-8664-c786ae2c1395-tmp\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093343 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt4vv\" (UniqueName: \"kubernetes.io/projected/1b80f305-7db1-4458-9919-4a956ac98551-kube-api-access-kt4vv\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093376 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-socket-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.094070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-kubernetes\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093459 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-kubelet-config\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093510 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-cni-netd\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093551 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8fjm\" (UniqueName: \"kubernetes.io/projected/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-kube-api-access-d8fjm\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093605 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-registration-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093627 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093661 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093727 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-sys\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093760 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b80f305-7db1-4458-9919-4a956ac98551-serviceca\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093784 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-sys-fs\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093810 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mzck\" (UniqueName: \"kubernetes.io/projected/14c41d9a-7ca5-4968-a6f4-fb2767f72283-kube-api-access-7mzck\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093837 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-etc-kubernetes\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093884 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093921 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-var-lib-kubelet\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093954 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-tuned\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.093977 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-slash\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.094673 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.094004 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc85k\" (UniqueName: \"kubernetes.io/projected/e1074956-ac86-412f-85b2-55a907fdac83-kube-api-access-cc85k\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.105900 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.105877 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 21:50:46.128852 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.128832 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:46.130069 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.130048 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s92lh" Sep 18 21:50:46.143367 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.143342 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s92lh" Sep 18 21:50:46.194212 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194188 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-var-lib-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194328 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194221 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-socket-dir-parent\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.194328 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194244 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.194328 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194266 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prndw\" (UniqueName: \"kubernetes.io/projected/2de0f77b-b8af-4621-99bb-86b1167904c1-kube-api-access-prndw\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:46.194448 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194323 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-var-lib-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194448 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194374 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-kubelet\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194448 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194397 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-socket-dir-parent\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.194448 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194407 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194448 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194434 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-cni-bin\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.194448 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194443 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-kubelet\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194462 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1074956-ac86-412f-85b2-55a907fdac83-multus-daemon-config\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194483 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-cni-bin\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194490 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffgfw\" (UniqueName: \"kubernetes.io/projected/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-kube-api-access-ffgfw\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194493 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194519 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194577 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-systemd-units\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194608 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-cni-multus\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194643 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194674 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.194702 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194707 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-cni-multus\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194718 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-env-overrides\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194757 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1074956-ac86-412f-85b2-55a907fdac83-cni-binary-copy\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.194781 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194698 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-systemd-units\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.194797 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret podName:51ec2d6b-b86c-4b83-92a7-3933a5d6ef46 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:46.694756786 +0000 UTC m=+3.671818289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret") pod "global-pull-secret-syncer-4wnpc" (UID: "51ec2d6b-b86c-4b83-92a7-3933a5d6ef46") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194902 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194917 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194940 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-system-cni-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.194996 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195028 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195052 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-cni-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195070 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-cni-binary-copy\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195087 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxgfp\" (UniqueName: \"kubernetes.io/projected/1200e5c4-bfff-4f92-8664-c786ae2c1395-kube-api-access-lxgfp\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195106 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195113 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1074956-ac86-412f-85b2-55a907fdac83-multus-daemon-config\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195130 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-device-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195180 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195183 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-device-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195197 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-cni-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.195465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195209 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-env-overrides\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195215 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-cnibin\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195235 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-system-cni-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195296 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysctl-d\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195327 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03-agent-certs\") pod \"konnectivity-agent-lh2wh\" (UID: \"9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03\") " pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195330 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-cnibin\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195353 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-etc-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195379 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-log-socket\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195405 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovnkube-script-lib\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195418 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1074956-ac86-412f-85b2-55a907fdac83-cni-binary-copy\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195429 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysctl-d\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195432 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e07c0afd-584c-49f8-a8d0-46497506f2b6-hosts-file\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195474 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-systemd\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195499 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-etc-openvswitch\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195500 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-cni-bin\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195533 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-cni-bin\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-cnibin\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195557 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-cni-binary-copy\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.196254 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195565 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-systemd\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195612 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-netns\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195569 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-netns\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195622 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e07c0afd-584c-49f8-a8d0-46497506f2b6-hosts-file\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195631 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-cnibin\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195651 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-kubelet\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195697 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-var-lib-kubelet\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195695 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195572 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-log-socket\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195700 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-conf-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195734 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-multus-conf-dir\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195769 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-system-cni-dir\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195810 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-host-slash\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195840 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-system-cni-dir\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195869 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-host-slash\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195894 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-lib-modules\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195918 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-node-log\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195934 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysconfig\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.197175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195950 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-run\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195967 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-host\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195987 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-lib-modules\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.195992 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1200e5c4-bfff-4f92-8664-c786ae2c1395-tmp\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196004 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-node-log\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196008 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysconfig\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196023 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-run\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196037 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt4vv\" (UniqueName: \"kubernetes.io/projected/1b80f305-7db1-4458-9919-4a956ac98551-kube-api-access-kt4vv\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196040 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovnkube-script-lib\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196048 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-host\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-socket-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196089 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-kubernetes\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196114 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-kubelet-config\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196138 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-cni-netd\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196155 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-kubernetes\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196172 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-kubelet-config\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196176 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8fjm\" (UniqueName: \"kubernetes.io/projected/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-kube-api-access-d8fjm\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196196 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-socket-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.198178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196202 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-cni-netd\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196225 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-registration-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196257 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196280 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196302 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-sys\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196312 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-registration-dir\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196355 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-sys\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.196383 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.196441 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:46.696425324 +0000 UTC m=+3.673486842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196384 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b80f305-7db1-4458-9919-4a956ac98551-serviceca\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196475 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-sys-fs\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196498 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mzck\" (UniqueName: \"kubernetes.io/projected/14c41d9a-7ca5-4968-a6f4-fb2767f72283-kube-api-access-7mzck\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196520 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-etc-kubernetes\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196541 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196546 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-sys-fs\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196563 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-var-lib-kubelet\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196598 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-tuned\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.198884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196605 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-var-lib-kubelet\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196619 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-etc-kubernetes\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-slash\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196650 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-slash\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196696 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc85k\" (UniqueName: \"kubernetes.io/projected/e1074956-ac86-412f-85b2-55a907fdac83-kube-api-access-cc85k\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196748 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03-konnectivity-ca\") pod \"konnectivity-agent-lh2wh\" (UID: \"9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03\") " pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196775 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-dbus\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196804 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-modprobe-d\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196860 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovn-node-metrics-cert\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196883 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef2b78c9-2057-4797-849a-d88a0ceccbab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196886 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-hostroot\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196929 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-hostroot\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196936 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qthx\" (UniqueName: \"kubernetes.io/projected/ef2b78c9-2057-4797-849a-d88a0ceccbab-kube-api-access-4qthx\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196968 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-iptables-alerter-script\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.196998 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-run-netns\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-ovn\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197051 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovnkube-config\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197064 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-modprobe-d\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.199486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197076 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07c0afd-584c-49f8-a8d0-46497506f2b6-tmp-dir\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197106 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz7c2\" (UniqueName: \"kubernetes.io/projected/e07c0afd-584c-49f8-a8d0-46497506f2b6-kube-api-access-qz7c2\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197127 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-run-ovn\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197137 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-k8s-cni-cncf-io\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197166 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b80f305-7db1-4458-9919-4a956ac98551-host\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197170 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-host-run-netns\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197198 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197230 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-multus-certs\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197260 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysctl-conf\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197296 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-systemd\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197488 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-systemd\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197604 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-iptables-alerter-script\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197766 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03-konnectivity-ca\") pod \"konnectivity-agent-lh2wh\" (UID: \"9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03\") " pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197870 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-dbus\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197912 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef2b78c9-2057-4797-849a-d88a0ceccbab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197980 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b80f305-7db1-4458-9919-4a956ac98551-host\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197985 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-k8s-cni-cncf-io\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.197983 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14c41d9a-7ca5-4968-a6f4-fb2767f72283-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.200201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.198046 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1074956-ac86-412f-85b2-55a907fdac83-host-run-multus-certs\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.200812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.198153 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-sysctl-conf\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.200812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.198241 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b80f305-7db1-4458-9919-4a956ac98551-serviceca\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.200812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.198282 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovnkube-config\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.200812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.198302 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e07c0afd-584c-49f8-a8d0-46497506f2b6-tmp-dir\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.200812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.199937 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1200e5c4-bfff-4f92-8664-c786ae2c1395-etc-tuned\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.200812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.200090 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1200e5c4-bfff-4f92-8664-c786ae2c1395-tmp\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.200812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.200204 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03-agent-certs\") pod \"konnectivity-agent-lh2wh\" (UID: \"9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03\") " pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:50:46.201043 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.200881 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-ovn-node-metrics-cert\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.222203 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.222179 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxgfp\" (UniqueName: \"kubernetes.io/projected/1200e5c4-bfff-4f92-8664-c786ae2c1395-kube-api-access-lxgfp\") pod \"tuned-27xpp\" (UID: \"1200e5c4-bfff-4f92-8664-c786ae2c1395\") " pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.223475 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.223437 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f04635d02a567d20d1ca9921c8ed991.slice/crio-19f7badad66d90390f66e823f8e9d0c26866e2f2905bf55f13322473e3d4114e WatchSource:0}: Error finding container 19f7badad66d90390f66e823f8e9d0c26866e2f2905bf55f13322473e3d4114e: Status 404 returned error can't find the container with id 19f7badad66d90390f66e823f8e9d0c26866e2f2905bf55f13322473e3d4114e Sep 18 21:50:46.223739 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.223718 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod262678f852fc1002c2fa89bce117a88a.slice/crio-4171ee02847d6ab13b67e6ad64fbc1e822fc003267491273fb68bdc24af6faea WatchSource:0}: Error finding container 4171ee02847d6ab13b67e6ad64fbc1e822fc003267491273fb68bdc24af6faea: Status 404 returned error can't find the container with id 4171ee02847d6ab13b67e6ad64fbc1e822fc003267491273fb68bdc24af6faea Sep 18 21:50:46.225660 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.225633 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffgfw\" (UniqueName: \"kubernetes.io/projected/87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb-kube-api-access-ffgfw\") pod \"iptables-alerter-l8kp2\" (UID: \"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb\") " pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.225828 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.225811 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prndw\" (UniqueName: \"kubernetes.io/projected/2de0f77b-b8af-4621-99bb-86b1167904c1-kube-api-access-prndw\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:46.227915 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.227895 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt4vv\" (UniqueName: \"kubernetes.io/projected/1b80f305-7db1-4458-9919-4a956ac98551-kube-api-access-kt4vv\") pod \"node-ca-kf47m\" (UID: \"1b80f305-7db1-4458-9919-4a956ac98551\") " pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.228180 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.228166 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:46.228235 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.228186 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:46.228235 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.228196 2553 projected.go:196] Error preparing data for projected volume kube-api-access-hrvzq for pod openshift-network-diagnostics/network-check-target-l94mz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:46.228300 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.228249 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq podName:bd0aff31-e558-4c27-aa2d-4f46e5e65b38 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:46.728235178 +0000 UTC m=+3.705296686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hrvzq" (UniqueName: "kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq") pod "network-check-target-l94mz" (UID: "bd0aff31-e558-4c27-aa2d-4f46e5e65b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:46.232116 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.232094 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 21:50:46.233695 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.233673 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qthx\" (UniqueName: \"kubernetes.io/projected/ef2b78c9-2057-4797-849a-d88a0ceccbab-kube-api-access-4qthx\") pod \"multus-additional-cni-plugins-nsdpg\" (UID: \"ef2b78c9-2057-4797-849a-d88a0ceccbab\") " pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.233801 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.233785 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mzck\" (UniqueName: \"kubernetes.io/projected/14c41d9a-7ca5-4968-a6f4-fb2767f72283-kube-api-access-7mzck\") pod \"aws-ebs-csi-driver-node-xwtbl\" (UID: \"14c41d9a-7ca5-4968-a6f4-fb2767f72283\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.233998 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.233982 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8fjm\" (UniqueName: \"kubernetes.io/projected/9a4620a6-8a39-4f96-a1f0-a2841608b7b8-kube-api-access-d8fjm\") pod \"ovnkube-node-lcc96\" (UID: \"9a4620a6-8a39-4f96-a1f0-a2841608b7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.236821 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.236798 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc85k\" (UniqueName: \"kubernetes.io/projected/e1074956-ac86-412f-85b2-55a907fdac83-kube-api-access-cc85k\") pod \"multus-42npz\" (UID: \"e1074956-ac86-412f-85b2-55a907fdac83\") " pod="openshift-multus/multus-42npz" Sep 18 21:50:46.243985 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.243967 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz7c2\" (UniqueName: \"kubernetes.io/projected/e07c0afd-584c-49f8-a8d0-46497506f2b6-kube-api-access-qz7c2\") pod \"node-resolver-dkbkd\" (UID: \"e07c0afd-584c-49f8-a8d0-46497506f2b6\") " pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.380529 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.380502 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:50:46.391052 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.391024 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4620a6_8a39_4f96_a1f0_a2841608b7b8.slice/crio-722471ac680f249e0ba010d86df1819df2662bc80ed7cba2bad297fe77c5171a WatchSource:0}: Error finding container 722471ac680f249e0ba010d86df1819df2662bc80ed7cba2bad297fe77c5171a: Status 404 returned error can't find the container with id 722471ac680f249e0ba010d86df1819df2662bc80ed7cba2bad297fe77c5171a Sep 18 21:50:46.400804 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.400782 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-l8kp2" Sep 18 21:50:46.409976 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.409955 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87591cd4_1f94_4cbc_ab9e_1b19e93a9cbb.slice/crio-a5837d523d29c6c484ae84a121fd7b1a70f88ab40e513b80dbe3488f6ffb0bb4 WatchSource:0}: Error finding container a5837d523d29c6c484ae84a121fd7b1a70f88ab40e513b80dbe3488f6ffb0bb4: Status 404 returned error can't find the container with id a5837d523d29c6c484ae84a121fd7b1a70f88ab40e513b80dbe3488f6ffb0bb4 Sep 18 21:50:46.412299 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.412274 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dkbkd" Sep 18 21:50:46.420396 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.420374 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07c0afd_584c_49f8_a8d0_46497506f2b6.slice/crio-2e89156047bb646817070381a267bb90e1563eca557e375b8d476bbb0e86cf1e WatchSource:0}: Error finding container 2e89156047bb646817070381a267bb90e1563eca557e375b8d476bbb0e86cf1e: Status 404 returned error can't find the container with id 2e89156047bb646817070381a267bb90e1563eca557e375b8d476bbb0e86cf1e Sep 18 21:50:46.425719 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.425699 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kf47m" Sep 18 21:50:46.434393 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.434369 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b80f305_7db1_4458_9919_4a956ac98551.slice/crio-49fa33177b51e165b7a88243b91fd4d01435198eb2add2ba65ab033969edcbde WatchSource:0}: Error finding container 49fa33177b51e165b7a88243b91fd4d01435198eb2add2ba65ab033969edcbde: Status 404 returned error can't find the container with id 49fa33177b51e165b7a88243b91fd4d01435198eb2add2ba65ab033969edcbde Sep 18 21:50:46.442880 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.442859 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-27xpp" Sep 18 21:50:46.449302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.449284 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:50:46.451078 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.451054 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1200e5c4_bfff_4f92_8664_c786ae2c1395.slice/crio-d3a4608b1286bc0201b32699da0351dbd291d00029d057c2cbdcc3b64e2fb203 WatchSource:0}: Error finding container d3a4608b1286bc0201b32699da0351dbd291d00029d057c2cbdcc3b64e2fb203: Status 404 returned error can't find the container with id d3a4608b1286bc0201b32699da0351dbd291d00029d057c2cbdcc3b64e2fb203 Sep 18 21:50:46.458050 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.458020 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1c0627_74c5_42f2_b7e1_2c4e00bf2f03.slice/crio-c8aedd15faa16e2929821b6bf280eaf3bab080b19aa005a728a69be080418fe3 WatchSource:0}: Error finding container c8aedd15faa16e2929821b6bf280eaf3bab080b19aa005a728a69be080418fe3: Status 404 returned error can't find the container with id c8aedd15faa16e2929821b6bf280eaf3bab080b19aa005a728a69be080418fe3 Sep 18 21:50:46.469469 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.469442 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" Sep 18 21:50:46.477603 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.477584 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c41d9a_7ca5_4968_a6f4_fb2767f72283.slice/crio-83f07b1ad3963f2b04b6128deeb65cf244e5dc92e914aaade907a5bde523e6d2 WatchSource:0}: Error finding container 83f07b1ad3963f2b04b6128deeb65cf244e5dc92e914aaade907a5bde523e6d2: Status 404 returned error can't find the container with id 83f07b1ad3963f2b04b6128deeb65cf244e5dc92e914aaade907a5bde523e6d2 Sep 18 21:50:46.488522 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.488503 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-42npz" Sep 18 21:50:46.492588 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.492575 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" Sep 18 21:50:46.497431 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.497410 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1074956_ac86_412f_85b2_55a907fdac83.slice/crio-fa317f1538d00a5f382bb99cc9983836e55cd9fe331bbab3e4b12532ae91c973 WatchSource:0}: Error finding container fa317f1538d00a5f382bb99cc9983836e55cd9fe331bbab3e4b12532ae91c973: Status 404 returned error can't find the container with id fa317f1538d00a5f382bb99cc9983836e55cd9fe331bbab3e4b12532ae91c973 Sep 18 21:50:46.502599 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:50:46.502572 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2b78c9_2057_4797_849a_d88a0ceccbab.slice/crio-cc48547f2202746c739757add4017a8b8d6850208300c886df0b91c63b8cc486 WatchSource:0}: Error finding container cc48547f2202746c739757add4017a8b8d6850208300c886df0b91c63b8cc486: Status 404 returned error can't find the container with id cc48547f2202746c739757add4017a8b8d6850208300c886df0b91c63b8cc486 Sep 18 21:50:46.700315 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.700229 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:46.700315 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.700300 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:46.700550 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.700438 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:46.700550 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.700506 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret podName:51ec2d6b-b86c-4b83-92a7-3933a5d6ef46 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:47.700485618 +0000 UTC m=+4.677547137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret") pod "global-pull-secret-syncer-4wnpc" (UID: "51ec2d6b-b86c-4b83-92a7-3933a5d6ef46") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:46.700663 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.700599 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:46.700718 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.700683 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:47.700624569 +0000 UTC m=+4.677686089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:46.801266 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:46.801229 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:46.801435 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.801419 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:46.801435 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.801436 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:46.801555 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.801448 2553 projected.go:196] Error preparing data for projected volume kube-api-access-hrvzq for pod openshift-network-diagnostics/network-check-target-l94mz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:46.801555 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:46.801507 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq podName:bd0aff31-e558-4c27-aa2d-4f46e5e65b38 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:47.801486208 +0000 UTC m=+4.778547711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrvzq" (UniqueName: "kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq") pod "network-check-target-l94mz" (UID: "bd0aff31-e558-4c27-aa2d-4f46e5e65b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:47.005914 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.005745 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:47.146884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.146826 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:45:46 +0000 UTC" deadline="2028-03-09 04:08:54.855775338 +0000 UTC" Sep 18 21:50:47.146884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.146864 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12894h18m7.708915824s" Sep 18 21:50:47.176602 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.176568 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:47.176809 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.176741 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:50:47.193978 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.193890 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-42npz" event={"ID":"e1074956-ac86-412f-85b2-55a907fdac83","Type":"ContainerStarted","Data":"fa317f1538d00a5f382bb99cc9983836e55cd9fe331bbab3e4b12532ae91c973"} Sep 18 21:50:47.201362 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.201263 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" event={"ID":"14c41d9a-7ca5-4968-a6f4-fb2767f72283","Type":"ContainerStarted","Data":"83f07b1ad3963f2b04b6128deeb65cf244e5dc92e914aaade907a5bde523e6d2"} Sep 18 21:50:47.222046 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.222007 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l8kp2" event={"ID":"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb","Type":"ContainerStarted","Data":"a5837d523d29c6c484ae84a121fd7b1a70f88ab40e513b80dbe3488f6ffb0bb4"} Sep 18 21:50:47.227213 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.227183 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lh2wh" event={"ID":"9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03","Type":"ContainerStarted","Data":"c8aedd15faa16e2929821b6bf280eaf3bab080b19aa005a728a69be080418fe3"} Sep 18 21:50:47.239922 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.239889 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-27xpp" event={"ID":"1200e5c4-bfff-4f92-8664-c786ae2c1395","Type":"ContainerStarted","Data":"d3a4608b1286bc0201b32699da0351dbd291d00029d057c2cbdcc3b64e2fb203"} Sep 18 21:50:47.303374 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.303278 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kf47m" event={"ID":"1b80f305-7db1-4458-9919-4a956ac98551","Type":"ContainerStarted","Data":"49fa33177b51e165b7a88243b91fd4d01435198eb2add2ba65ab033969edcbde"} Sep 18 21:50:47.320993 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.320952 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dkbkd" event={"ID":"e07c0afd-584c-49f8-a8d0-46497506f2b6","Type":"ContainerStarted","Data":"2e89156047bb646817070381a267bb90e1563eca557e375b8d476bbb0e86cf1e"} Sep 18 21:50:47.349729 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.349576 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"722471ac680f249e0ba010d86df1819df2662bc80ed7cba2bad297fe77c5171a"} Sep 18 21:50:47.360789 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.360707 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" event={"ID":"5f04635d02a567d20d1ca9921c8ed991","Type":"ContainerStarted","Data":"19f7badad66d90390f66e823f8e9d0c26866e2f2905bf55f13322473e3d4114e"} Sep 18 21:50:47.367851 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.367765 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" event={"ID":"262678f852fc1002c2fa89bce117a88a","Type":"ContainerStarted","Data":"4171ee02847d6ab13b67e6ad64fbc1e822fc003267491273fb68bdc24af6faea"} Sep 18 21:50:47.393212 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.393121 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" event={"ID":"ef2b78c9-2057-4797-849a-d88a0ceccbab","Type":"ContainerStarted","Data":"cc48547f2202746c739757add4017a8b8d6850208300c886df0b91c63b8cc486"} Sep 18 21:50:47.591745 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.591658 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 21:50:47.709111 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.708995 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:47.709111 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.709066 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:47.709350 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.709195 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:47.709350 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.709255 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:49.709236111 +0000 UTC m=+6.686297617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:47.709683 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.709637 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:47.709776 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.709763 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret podName:51ec2d6b-b86c-4b83-92a7-3933a5d6ef46 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:49.709740187 +0000 UTC m=+6.686801693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret") pod "global-pull-secret-syncer-4wnpc" (UID: "51ec2d6b-b86c-4b83-92a7-3933a5d6ef46") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:47.810300 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:47.810183 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:47.810479 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.810407 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:47.810479 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.810428 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:47.810479 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.810441 2553 projected.go:196] Error preparing data for projected volume kube-api-access-hrvzq for pod openshift-network-diagnostics/network-check-target-l94mz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:47.810634 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:47.810506 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq podName:bd0aff31-e558-4c27-aa2d-4f46e5e65b38 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:49.810481217 +0000 UTC m=+6.787542725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrvzq" (UniqueName: "kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq") pod "network-check-target-l94mz" (UID: "bd0aff31-e558-4c27-aa2d-4f46e5e65b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:48.147733 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:48.147674 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:45:46 +0000 UTC" deadline="2028-06-19 05:03:12.41941919 +0000 UTC" Sep 18 21:50:48.147733 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:48.147731 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15343h12m24.271691883s" Sep 18 21:50:48.177071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:48.176384 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:48.177071 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:48.176517 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:50:48.177071 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:48.176899 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:48.177071 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:48.176990 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:50:49.178331 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:49.178299 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:49.178830 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.178438 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:50:49.728291 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:49.728253 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:49.728462 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:49.728334 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:49.728520 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.728468 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:49.728567 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.728534 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:53.728514006 +0000 UTC m=+10.705575513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:49.728937 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.728917 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:49.729046 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.728972 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret podName:51ec2d6b-b86c-4b83-92a7-3933a5d6ef46 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:53.728956927 +0000 UTC m=+10.706018435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret") pod "global-pull-secret-syncer-4wnpc" (UID: "51ec2d6b-b86c-4b83-92a7-3933a5d6ef46") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:49.829014 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:49.828980 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:49.829195 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.829138 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:49.829195 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.829164 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:49.829306 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.829203 2553 projected.go:196] Error preparing data for projected volume kube-api-access-hrvzq for pod openshift-network-diagnostics/network-check-target-l94mz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:49.829306 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:49.829273 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq podName:bd0aff31-e558-4c27-aa2d-4f46e5e65b38 nodeName:}" failed. No retries permitted until 2026-09-18 21:50:53.829252438 +0000 UTC m=+10.806313963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrvzq" (UniqueName: "kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq") pod "network-check-target-l94mz" (UID: "bd0aff31-e558-4c27-aa2d-4f46e5e65b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:50.176300 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:50.176260 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:50.176486 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:50.176389 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:50:50.176803 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:50.176782 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:50.176921 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:50.176876 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:50:51.176181 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:51.176150 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:51.176630 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:51.176296 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:50:52.176095 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:52.176060 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:52.176263 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:52.176229 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:50:52.176568 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:52.176272 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:52.176568 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:52.176363 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:50:53.177210 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:53.176786 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:53.177210 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.176907 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:50:53.760652 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:53.760597 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:53.760853 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:53.760701 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:53.760853 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.760773 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:53.760853 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.760824 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:53.760853 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.760843 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret podName:51ec2d6b-b86c-4b83-92a7-3933a5d6ef46 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:01.760824008 +0000 UTC m=+18.737885524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret") pod "global-pull-secret-syncer-4wnpc" (UID: "51ec2d6b-b86c-4b83-92a7-3933a5d6ef46") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:50:53.761051 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.760881 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:01.760863348 +0000 UTC m=+18.737924853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:50:53.862677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:53.862048 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:53.862677 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.862241 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:50:53.862677 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.862265 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:50:53.862677 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.862278 2553 projected.go:196] Error preparing data for projected volume kube-api-access-hrvzq for pod openshift-network-diagnostics/network-check-target-l94mz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:53.862677 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:53.862335 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq podName:bd0aff31-e558-4c27-aa2d-4f46e5e65b38 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:01.862317078 +0000 UTC m=+18.839378596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrvzq" (UniqueName: "kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq") pod "network-check-target-l94mz" (UID: "bd0aff31-e558-4c27-aa2d-4f46e5e65b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:50:54.176674 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:54.176622 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:54.176841 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:54.176773 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:50:54.176899 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:54.176843 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:54.176945 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:54.176916 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:50:55.177699 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:55.177283 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:55.177699 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:55.177407 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:50:56.176516 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:56.176484 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:56.176722 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:56.176497 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:56.176722 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:56.176589 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:50:56.176722 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:56.176706 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:50:57.175966 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:57.175931 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:57.176353 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:57.176048 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:50:58.175897 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:58.175856 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:50:58.176156 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:58.175856 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:50:58.176156 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:58.175962 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:50:58.176156 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:58.176034 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:50:59.176532 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:50:59.176492 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:50:59.177007 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:50:59.176631 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:00.175994 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:00.175956 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:00.176222 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:00.175956 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:00.176222 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:00.176092 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:00.176222 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:00.176157 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:01.176615 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:01.176580 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:01.177010 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.176739 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:01.817301 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:01.817191 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:01.817301 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:01.817268 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:01.817572 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.817361 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:51:01.817572 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.817380 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:51:01.817572 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.817432 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret podName:51ec2d6b-b86c-4b83-92a7-3933a5d6ef46 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:17.817412777 +0000 UTC m=+34.794474300 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret") pod "global-pull-secret-syncer-4wnpc" (UID: "51ec2d6b-b86c-4b83-92a7-3933a5d6ef46") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:51:01.817572 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.817450 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:17.817440443 +0000 UTC m=+34.794501946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:51:01.917847 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:01.917805 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:01.918047 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.918025 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:51:01.918117 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.918054 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:51:01.918117 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.918068 2553 projected.go:196] Error preparing data for projected volume kube-api-access-hrvzq for pod openshift-network-diagnostics/network-check-target-l94mz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:51:01.918232 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:01.918135 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq podName:bd0aff31-e558-4c27-aa2d-4f46e5e65b38 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:17.918113719 +0000 UTC m=+34.895175238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrvzq" (UniqueName: "kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq") pod "network-check-target-l94mz" (UID: "bd0aff31-e558-4c27-aa2d-4f46e5e65b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:51:02.176540 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:02.176505 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:02.176816 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:02.176546 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:02.176816 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:02.176628 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:02.176816 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:02.176779 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:03.176801 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:03.176767 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:03.176983 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:03.176927 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:04.176055 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:04.176011 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:04.176238 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:04.176071 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:04.176238 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:04.176155 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:04.176347 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:04.176253 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:05.177032 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:05.177010 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:05.177310 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:05.177093 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:05.438730 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:05.438539 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" event={"ID":"5f04635d02a567d20d1ca9921c8ed991","Type":"ContainerStarted","Data":"96c6393f7ae67319987c8da015d490d664a5ba8cc5492edf1723be245a25f512"} Sep 18 21:51:06.176677 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.176641 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:06.176780 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:06.176757 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:06.176848 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.176818 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:06.177003 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:06.176892 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:06.442717 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.442611 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-27xpp" event={"ID":"1200e5c4-bfff-4f92-8664-c786ae2c1395","Type":"ContainerStarted","Data":"8fff4943a20067d1fe0ce57b1545ca44f6fbc6cc1b3c6f02d1ecc31411c5ff43"} Sep 18 21:51:06.444114 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.444088 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kf47m" event={"ID":"1b80f305-7db1-4458-9919-4a956ac98551","Type":"ContainerStarted","Data":"edd417384a9d69b9895b339fed99c8d757227647421dc44f24e71c1d1f5be800"} Sep 18 21:51:06.445523 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.445495 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dkbkd" event={"ID":"e07c0afd-584c-49f8-a8d0-46497506f2b6","Type":"ContainerStarted","Data":"e7ebac18ba2070bf38d7bfef78bce9ee97c35382ad56aa6c0f1fc3c34b806de2"} Sep 18 21:51:06.448706 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.448658 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"dc50a07227ca6499369f98bd4540db8a1475d2b06ce021d84fa0cbb0cd6e3174"} Sep 18 21:51:06.448817 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.448748 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"4512d50a4b7dce1dfef53287024c5dc45eb2c64576a28e859e1d43afbf58504e"} Sep 18 21:51:06.448817 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.448800 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"29baa469ceba9e242e28e811ebed22b93bd606dcbb30d3b89f8d359e852c273b"} Sep 18 21:51:06.448922 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.448847 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"815692c47847ef4fec116c3ae76add6899e6047c8dc801886ba3eec77bb9e0df"} Sep 18 21:51:06.448922 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.448895 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"6e26661ae3150fddbbfbf516952c7f25b3d67d38c7a7d70ba7dcff13de7effd5"} Sep 18 21:51:06.449020 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.448942 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"ddbfa20020d53365db391d6bcb0ce54a3071d445fccf655530da872908aa14f9"} Sep 18 21:51:06.450189 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.450168 2553 generic.go:356] "Generic (PLEG): container finished" podID="262678f852fc1002c2fa89bce117a88a" containerID="6621d9fe58238bbd09203ef7297daa4fea384f38b882ac44184096db082e1366" exitCode=0 Sep 18 21:51:06.450301 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.450228 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" event={"ID":"262678f852fc1002c2fa89bce117a88a","Type":"ContainerDied","Data":"6621d9fe58238bbd09203ef7297daa4fea384f38b882ac44184096db082e1366"} Sep 18 21:51:06.451825 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.451804 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef2b78c9-2057-4797-849a-d88a0ceccbab" containerID="a76f0b59fbcdddc447f10a561f78a2b81035d5abe833035fad6915e1b2557a26" exitCode=0 Sep 18 21:51:06.451927 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.451863 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" event={"ID":"ef2b78c9-2057-4797-849a-d88a0ceccbab","Type":"ContainerDied","Data":"a76f0b59fbcdddc447f10a561f78a2b81035d5abe833035fad6915e1b2557a26"} Sep 18 21:51:06.453477 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.453459 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-42npz" event={"ID":"e1074956-ac86-412f-85b2-55a907fdac83","Type":"ContainerStarted","Data":"9c9e04cc5adcaafb67e6291f3eadb936223d1d9e49ee2f6cf5fe57b20532c91b"} Sep 18 21:51:06.455352 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.455329 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" event={"ID":"14c41d9a-7ca5-4968-a6f4-fb2767f72283","Type":"ContainerStarted","Data":"f07b76ed81545ac9728fa3d7eca6bb00fd2d6330bd7e8fa980ee29ef894b18ad"} Sep 18 21:51:06.458374 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.457861 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lh2wh" event={"ID":"9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03","Type":"ContainerStarted","Data":"301acf325be7202c4d1ddeb792d8953f040532c196dc0534854bce34374b0741"} Sep 18 21:51:06.490467 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.490419 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-133.ec2.internal" podStartSLOduration=20.49039761 podStartE2EDuration="20.49039761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:05.463941407 +0000 UTC m=+22.441002925" watchObservedRunningTime="2026-09-18 21:51:06.49039761 +0000 UTC m=+23.467459138" Sep 18 21:51:06.528900 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.528852 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-27xpp" podStartSLOduration=2.837459625 podStartE2EDuration="21.528832261s" totalImagesPullingTime="18.691372636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:06.494074447 +0000 UTC m=+23.471135971" watchObservedRunningTime="2026-09-18 21:51:06.528832261 +0000 UTC m=+23.505893785" Sep 18 21:51:06.560357 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.560301 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-42npz" podStartSLOduration=2.5974826540000002 podStartE2EDuration="21.560280036s" totalImagesPullingTime="18.962797382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:06.52903689 +0000 UTC m=+23.506098440" watchObservedRunningTime="2026-09-18 21:51:06.560280036 +0000 UTC m=+23.537341562" Sep 18 21:51:06.583501 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.583450 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dkbkd" podStartSLOduration=2.856168596 podStartE2EDuration="21.583434063s" totalImagesPullingTime="18.727265467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:06.560191953 +0000 UTC m=+23.537253477" watchObservedRunningTime="2026-09-18 21:51:06.583434063 +0000 UTC m=+23.560495586" Sep 18 21:51:06.583629 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.583526 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kf47m" podStartSLOduration=2.913058662 podStartE2EDuration="21.583522358s" totalImagesPullingTime="18.670463696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:06.583327465 +0000 UTC m=+23.560388988" watchObservedRunningTime="2026-09-18 21:51:06.583522358 +0000 UTC m=+23.560583882" Sep 18 21:51:06.638102 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.638043 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lh2wh" podStartSLOduration=2.990229337 podStartE2EDuration="21.638022856s" totalImagesPullingTime="18.647793519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:06.609501306 +0000 UTC m=+23.586562853" watchObservedRunningTime="2026-09-18 21:51:06.638022856 +0000 UTC m=+23.615084381" Sep 18 21:51:06.747069 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:06.747047 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 21:51:07.154307 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.154191 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T21:51:06.747064219Z","UUID":"3c441a10-c0a6-4bdc-abe6-659e248f453a","Handler":null,"Name":"","Endpoint":""} Sep 18 21:51:07.156112 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.156085 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 21:51:07.156263 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.156124 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 21:51:07.176763 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.176722 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:07.176921 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:07.176875 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:07.461873 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.461788 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" event={"ID":"262678f852fc1002c2fa89bce117a88a","Type":"ContainerStarted","Data":"4fdcb3541815072f103bebdefc1e2a81e2a9e79b897000c4d02786001b1df5c1"} Sep 18 21:51:07.463931 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.463905 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" event={"ID":"14c41d9a-7ca5-4968-a6f4-fb2767f72283","Type":"ContainerStarted","Data":"57ed99d9d1630ae5c3ce3acb32a41092a17adf2f0268b91aa77ce93ad0dee58e"} Sep 18 21:51:07.465573 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.465507 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-l8kp2" event={"ID":"87591cd4-1f94-4cbc-ab9e-1b19e93a9cbb","Type":"ContainerStarted","Data":"f2c7d0c4766583dfb531f8e781dc20b401815a3d85b2034dc5f002bb95f8c16b"} Sep 18 21:51:07.481180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.481130 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-133.ec2.internal" podStartSLOduration=22.481111797 podStartE2EDuration="22.481111797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:07.480315922 +0000 UTC m=+24.457377473" watchObservedRunningTime="2026-09-18 21:51:07.481111797 +0000 UTC m=+24.458173322" Sep 18 21:51:07.498868 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:07.498814 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-l8kp2" podStartSLOduration=3.80310991 podStartE2EDuration="22.498796076s" totalImagesPullingTime="18.695686166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:07.498064481 +0000 UTC m=+24.475126032" watchObservedRunningTime="2026-09-18 21:51:07.498796076 +0000 UTC m=+24.475857600" Sep 18 21:51:08.176116 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:08.176078 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:08.176273 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:08.176078 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:08.176273 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:08.176198 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:08.176392 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:08.176302 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:08.472377 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:08.472287 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"9eac1fa061ad7cc82c9de432a3247be13851ce4843f9b02ddde85ee0f6ba0d18"} Sep 18 21:51:08.474548 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:08.474508 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" event={"ID":"14c41d9a-7ca5-4968-a6f4-fb2767f72283","Type":"ContainerStarted","Data":"da88c6980070dc67c004aeac3b6ab15e9fdb3c3c93099c3fae7e1984f8d7a67f"} Sep 18 21:51:08.494140 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:08.494111 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:51:08.505023 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:08.504981 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwtbl" podStartSLOduration=3.368713289 podStartE2EDuration="23.504964632s" totalImagesPullingTime="20.136251343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:08.503656542 +0000 UTC m=+25.480718065" watchObservedRunningTime="2026-09-18 21:51:08.504964632 +0000 UTC m=+25.482026150" Sep 18 21:51:09.176382 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:09.176353 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:09.176562 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:09.176486 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:09.294995 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:09.294959 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:51:09.295738 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:09.295696 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:51:09.477641 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:09.477559 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lh2wh" Sep 18 21:51:10.176201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:10.176165 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:10.176384 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:10.176298 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:10.176384 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:10.176358 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:10.176503 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:10.176483 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:10.487289 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:10.485717 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" event={"ID":"9a4620a6-8a39-4f96-a1f0-a2841608b7b8","Type":"ContainerStarted","Data":"d3b720c6a53790ec91bf53a6014749724d7616f78246a43aa497a6d570d27b72"} Sep 18 21:51:10.525361 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:10.524785 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" podStartSLOduration=6.381554828 podStartE2EDuration="25.524764432s" totalImagesPullingTime="19.143209604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:10.524349494 +0000 UTC m=+27.501411018" watchObservedRunningTime="2026-09-18 21:51:10.524764432 +0000 UTC m=+27.501825957" Sep 18 21:51:11.175806 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:11.175774 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:11.175938 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:11.175885 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:11.489485 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:11.489397 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef2b78c9-2057-4797-849a-d88a0ceccbab" containerID="e50e70defff85dd0313a38ffe79a28590dd2f6f2335e2568209e64222a953b80" exitCode=0 Sep 18 21:51:11.489996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:11.489490 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" event={"ID":"ef2b78c9-2057-4797-849a-d88a0ceccbab","Type":"ContainerDied","Data":"e50e70defff85dd0313a38ffe79a28590dd2f6f2335e2568209e64222a953b80"} Sep 18 21:51:11.490770 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:11.490241 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:51:11.490770 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:11.490302 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:51:11.490770 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:11.490335 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:51:11.505089 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:11.505066 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:51:11.508070 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:11.508052 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:51:12.176237 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.176206 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:12.176415 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:12.176347 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:12.176415 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.176400 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:12.176531 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:12.176511 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:12.422889 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.422856 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4wnpc"] Sep 18 21:51:12.435377 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.435321 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ndv9n"] Sep 18 21:51:12.435495 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.435426 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:12.435534 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:12.435512 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:12.438333 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.438309 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l94mz"] Sep 18 21:51:12.494051 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.494022 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef2b78c9-2057-4797-849a-d88a0ceccbab" containerID="de5dba0326b53fbf8b4f3fede6ce21cdf718d9b18b5f1cf1816367da1ef7c567" exitCode=0 Sep 18 21:51:12.494647 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.494108 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" event={"ID":"ef2b78c9-2057-4797-849a-d88a0ceccbab","Type":"ContainerDied","Data":"de5dba0326b53fbf8b4f3fede6ce21cdf718d9b18b5f1cf1816367da1ef7c567"} Sep 18 21:51:12.494647 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.494137 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:12.494647 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:12.494424 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:12.495108 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:12.494817 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:12.495108 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:12.494899 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:13.499187 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:13.499104 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef2b78c9-2057-4797-849a-d88a0ceccbab" containerID="7334d066279e6e5a46792f90f8748b433a4ac746b7c3290dc5a2f20730e7431d" exitCode=0 Sep 18 21:51:13.499595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:13.499189 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" event={"ID":"ef2b78c9-2057-4797-849a-d88a0ceccbab","Type":"ContainerDied","Data":"7334d066279e6e5a46792f90f8748b433a4ac746b7c3290dc5a2f20730e7431d"} Sep 18 21:51:14.176984 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:14.176752 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:14.177153 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:14.176751 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:14.177153 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:14.176792 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:14.177153 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:14.177104 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:14.177301 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:14.177189 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:14.177301 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:14.177263 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:16.175826 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:16.175792 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:16.175826 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:16.175815 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:16.176338 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:16.175792 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:16.176338 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:16.175902 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:16.176338 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:16.175986 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:16.176338 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:16.176055 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:17.824846 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:17.824805 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:17.825210 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:17.824894 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:17.825210 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:17.824944 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 21:51:17.825210 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:17.824980 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:51:17.825210 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:17.825010 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret podName:51ec2d6b-b86c-4b83-92a7-3933a5d6ef46 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:49.824991285 +0000 UTC m=+66.802052804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret") pod "global-pull-secret-syncer-4wnpc" (UID: "51ec2d6b-b86c-4b83-92a7-3933a5d6ef46") : object "kube-system"/"original-pull-secret" not registered Sep 18 21:51:17.825210 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:17.825026 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:49.825019464 +0000 UTC m=+66.802080965 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 21:51:17.925704 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:17.925655 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:17.925851 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:17.925829 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 21:51:17.925942 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:17.925858 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 21:51:17.925942 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:17.925873 2553 projected.go:196] Error preparing data for projected volume kube-api-access-hrvzq for pod openshift-network-diagnostics/network-check-target-l94mz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:51:17.926046 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:17.925942 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq podName:bd0aff31-e558-4c27-aa2d-4f46e5e65b38 nodeName:}" failed. No retries permitted until 2026-09-18 21:51:49.92592363 +0000 UTC m=+66.902985133 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hrvzq" (UniqueName: "kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq") pod "network-check-target-l94mz" (UID: "bd0aff31-e558-4c27-aa2d-4f46e5e65b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 21:51:18.176549 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.176512 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:18.176549 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.176548 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:18.176758 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:18.176636 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l94mz" podUID="bd0aff31-e558-4c27-aa2d-4f46e5e65b38" Sep 18 21:51:18.176758 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.176692 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:18.176823 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:18.176795 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4wnpc" podUID="51ec2d6b-b86c-4b83-92a7-3933a5d6ef46" Sep 18 21:51:18.176888 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:18.176872 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:51:18.272026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.271988 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:18.375911 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.375876 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:18.413488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.413459 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-133.ec2.internal" event="NodeReady" Sep 18 21:51:18.413633 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.413579 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 21:51:18.466092 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.466065 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-shllc"] Sep 18 21:51:18.483271 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.483248 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ksgsm"] Sep 18 21:51:18.483419 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.483381 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.490795 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.490769 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 21:51:18.490913 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.490825 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-np4sp\"" Sep 18 21:51:18.490913 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.490861 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 21:51:18.499948 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.499927 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-shllc"] Sep 18 21:51:18.500059 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.499961 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ksgsm"] Sep 18 21:51:18.500059 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.500034 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ksgsm" Sep 18 21:51:18.504130 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.504114 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xt9d9\"" Sep 18 21:51:18.504246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.504228 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 21:51:18.504719 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.504700 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 21:51:18.504992 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.504977 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 21:51:18.513500 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.513478 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef2b78c9-2057-4797-849a-d88a0ceccbab" containerID="c296ca5ff4b8cacc6c63e1d1c282a2269d6adfff1467bd8c9f52e0ba76b6a1b0" exitCode=0 Sep 18 21:51:18.513610 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.513510 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" event={"ID":"ef2b78c9-2057-4797-849a-d88a0ceccbab","Type":"ContainerDied","Data":"c296ca5ff4b8cacc6c63e1d1c282a2269d6adfff1467bd8c9f52e0ba76b6a1b0"} Sep 18 21:51:18.630411 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.630387 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.630506 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.630447 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7249b8d1-5008-48e4-94ea-079001c7a03e-config-volume\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.630506 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.630482 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4ee511-aedd-4e1d-8a06-f427ca0f2f03-cert\") pod \"ingress-canary-ksgsm\" (UID: \"1f4ee511-aedd-4e1d-8a06-f427ca0f2f03\") " pod="openshift-ingress-canary/ingress-canary-ksgsm" Sep 18 21:51:18.630760 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.630737 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5v8b\" (UniqueName: \"kubernetes.io/projected/1f4ee511-aedd-4e1d-8a06-f427ca0f2f03-kube-api-access-v5v8b\") pod \"ingress-canary-ksgsm\" (UID: \"1f4ee511-aedd-4e1d-8a06-f427ca0f2f03\") " pod="openshift-ingress-canary/ingress-canary-ksgsm" Sep 18 21:51:18.630884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.630773 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7249b8d1-5008-48e4-94ea-079001c7a03e-tmp-dir\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.630884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.630814 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drq97\" (UniqueName: \"kubernetes.io/projected/7249b8d1-5008-48e4-94ea-079001c7a03e-kube-api-access-drq97\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.731866 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.731836 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7249b8d1-5008-48e4-94ea-079001c7a03e-config-volume\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.731866 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.731873 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4ee511-aedd-4e1d-8a06-f427ca0f2f03-cert\") pod \"ingress-canary-ksgsm\" (UID: \"1f4ee511-aedd-4e1d-8a06-f427ca0f2f03\") " pod="openshift-ingress-canary/ingress-canary-ksgsm" Sep 18 21:51:18.732130 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.731912 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5v8b\" (UniqueName: \"kubernetes.io/projected/1f4ee511-aedd-4e1d-8a06-f427ca0f2f03-kube-api-access-v5v8b\") pod \"ingress-canary-ksgsm\" (UID: \"1f4ee511-aedd-4e1d-8a06-f427ca0f2f03\") " pod="openshift-ingress-canary/ingress-canary-ksgsm" Sep 18 21:51:18.732130 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.731930 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7249b8d1-5008-48e4-94ea-079001c7a03e-tmp-dir\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.732245 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.732215 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drq97\" (UniqueName: \"kubernetes.io/projected/7249b8d1-5008-48e4-94ea-079001c7a03e-kube-api-access-drq97\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.732336 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.732317 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.732443 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:18.732428 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:18.732501 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.732450 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7249b8d1-5008-48e4-94ea-079001c7a03e-tmp-dir\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.732501 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:18.732488 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls podName:7249b8d1-5008-48e4-94ea-079001c7a03e nodeName:}" failed. No retries permitted until 2026-09-18 21:51:19.232470686 +0000 UTC m=+36.209532207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls") pod "dns-default-shllc" (UID: "7249b8d1-5008-48e4-94ea-079001c7a03e") : secret "dns-default-metrics-tls" not found Sep 18 21:51:18.732609 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.732510 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7249b8d1-5008-48e4-94ea-079001c7a03e-config-volume\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.736005 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.735985 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1f4ee511-aedd-4e1d-8a06-f427ca0f2f03-cert\") pod \"ingress-canary-ksgsm\" (UID: \"1f4ee511-aedd-4e1d-8a06-f427ca0f2f03\") " pod="openshift-ingress-canary/ingress-canary-ksgsm" Sep 18 21:51:18.741933 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.741913 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5v8b\" (UniqueName: \"kubernetes.io/projected/1f4ee511-aedd-4e1d-8a06-f427ca0f2f03-kube-api-access-v5v8b\") pod \"ingress-canary-ksgsm\" (UID: \"1f4ee511-aedd-4e1d-8a06-f427ca0f2f03\") " pod="openshift-ingress-canary/ingress-canary-ksgsm" Sep 18 21:51:18.742265 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.742246 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drq97\" (UniqueName: \"kubernetes.io/projected/7249b8d1-5008-48e4-94ea-079001c7a03e-kube-api-access-drq97\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:18.808506 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:18.808470 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ksgsm" Sep 18 21:51:19.132551 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:19.132114 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ksgsm"] Sep 18 21:51:19.135350 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:51:19.135323 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f4ee511_aedd_4e1d_8a06_f427ca0f2f03.slice/crio-bd69d80720f36f84043ca039ba42213b89223ec38c9f798c2e37efd0106465ea WatchSource:0}: Error finding container bd69d80720f36f84043ca039ba42213b89223ec38c9f798c2e37efd0106465ea: Status 404 returned error can't find the container with id bd69d80720f36f84043ca039ba42213b89223ec38c9f798c2e37efd0106465ea Sep 18 21:51:19.236692 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:19.236581 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:19.236933 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:19.236739 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:19.236933 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:19.236808 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls podName:7249b8d1-5008-48e4-94ea-079001c7a03e nodeName:}" failed. No retries permitted until 2026-09-18 21:51:20.236788721 +0000 UTC m=+37.213850222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls") pod "dns-default-shllc" (UID: "7249b8d1-5008-48e4-94ea-079001c7a03e") : secret "dns-default-metrics-tls" not found Sep 18 21:51:19.519646 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:19.519558 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ksgsm" event={"ID":"1f4ee511-aedd-4e1d-8a06-f427ca0f2f03","Type":"ContainerStarted","Data":"bd69d80720f36f84043ca039ba42213b89223ec38c9f798c2e37efd0106465ea"} Sep 18 21:51:19.522484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:19.522459 2553 generic.go:356] "Generic (PLEG): container finished" podID="ef2b78c9-2057-4797-849a-d88a0ceccbab" containerID="f3315624c2748bae27effecc655511b3e8d0467b98e46eba8448235be172eded" exitCode=0 Sep 18 21:51:19.522587 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:19.522511 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" event={"ID":"ef2b78c9-2057-4797-849a-d88a0ceccbab","Type":"ContainerDied","Data":"f3315624c2748bae27effecc655511b3e8d0467b98e46eba8448235be172eded"} Sep 18 21:51:20.176080 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.176036 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:20.176080 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.176068 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:20.176080 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.176067 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:20.177418 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.177368 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:20.178530 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.178513 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-678rx\"" Sep 18 21:51:20.182492 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.182472 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 21:51:20.182756 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.182707 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 21:51:20.182756 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.182731 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 21:51:20.182961 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.182941 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5rt7r\"" Sep 18 21:51:20.182961 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.182954 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 21:51:20.245359 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.245322 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:20.245527 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:20.245459 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:20.245527 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:20.245521 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls podName:7249b8d1-5008-48e4-94ea-079001c7a03e nodeName:}" failed. No retries permitted until 2026-09-18 21:51:22.245505631 +0000 UTC m=+39.222567140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls") pod "dns-default-shllc" (UID: "7249b8d1-5008-48e4-94ea-079001c7a03e") : secret "dns-default-metrics-tls" not found Sep 18 21:51:20.283152 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.283120 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:20.528607 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.528525 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" event={"ID":"ef2b78c9-2057-4797-849a-d88a0ceccbab","Type":"ContainerStarted","Data":"ee0a0475f1eab9eebf97f38d5a3d133ae48a0cb9e65bba9be8d3ec2b845c649b"} Sep 18 21:51:20.552731 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.552680 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nsdpg" podStartSLOduration=7.15104306 podStartE2EDuration="35.552643172s" totalImagesPullingTime="28.401600112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:20.551870671 +0000 UTC m=+37.528932194" watchObservedRunningTime="2026-09-18 21:51:20.552643172 +0000 UTC m=+37.529704690" Sep 18 21:51:20.682686 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.682639 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:20.761653 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:20.761616 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:22.262944 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:22.262860 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:22.263467 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:22.263015 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:22.263467 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:22.263085 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls podName:7249b8d1-5008-48e4-94ea-079001c7a03e nodeName:}" failed. No retries permitted until 2026-09-18 21:51:26.263064352 +0000 UTC m=+43.240125854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls") pod "dns-default-shllc" (UID: "7249b8d1-5008-48e4-94ea-079001c7a03e") : secret "dns-default-metrics-tls" not found Sep 18 21:51:22.534146 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:22.534067 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ksgsm" event={"ID":"1f4ee511-aedd-4e1d-8a06-f427ca0f2f03","Type":"ContainerStarted","Data":"bd2f3d1336fac703509fd232c4c189ca109737673d8a30584e255023b13a9b95"} Sep 18 21:51:22.558613 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:22.558565 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ksgsm" podStartSLOduration=2.068593096 podStartE2EDuration="4.558550614s" totalImagesPullingTime="2.489957518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:22.55828949 +0000 UTC m=+39.535351013" watchObservedRunningTime="2026-09-18 21:51:22.558550614 +0000 UTC m=+39.535612139" Sep 18 21:51:23.376114 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:23.376070 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:23.497887 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:23.497849 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:25.892457 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:25.892416 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:25.993059 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:25.993012 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:26.292116 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:26.292040 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:26.292254 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:26.292155 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:26.292254 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:26.292210 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls podName:7249b8d1-5008-48e4-94ea-079001c7a03e nodeName:}" failed. No retries permitted until 2026-09-18 21:51:34.292194685 +0000 UTC m=+51.269256201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls") pod "dns-default-shllc" (UID: "7249b8d1-5008-48e4-94ea-079001c7a03e") : secret "dns-default-metrics-tls" not found Sep 18 21:51:27.235374 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:27.235342 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:27.335710 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:27.335678 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:29.546504 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:29.546474 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:29.615775 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:29.615722 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:34.348017 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:34.347969 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:34.348493 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:34.348126 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:34.348493 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:34.348211 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls podName:7249b8d1-5008-48e4-94ea-079001c7a03e nodeName:}" failed. No retries permitted until 2026-09-18 21:51:50.348191115 +0000 UTC m=+67.325252620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls") pod "dns-default-shllc" (UID: "7249b8d1-5008-48e4-94ea-079001c7a03e") : secret "dns-default-metrics-tls" not found Sep 18 21:51:39.196028 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:39.195930 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:39.296133 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:39.296099 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:43.509105 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:43.509078 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lcc96" Sep 18 21:51:43.675017 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:43.674980 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:43.778099 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:43.778020 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:43.863063 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:43.863021 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:47.831526 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:47.831489 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:47.904290 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:47.904239 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:49.852770 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.852730 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:49.853155 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.852799 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:51:49.855218 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.855183 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 21:51:49.855337 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.855304 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 21:51:49.863370 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:49.863348 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 21:51:49.863480 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:49.863407 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:53.863391354 +0000 UTC m=+130.840452862 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : secret "metrics-daemon-secret" not found Sep 18 21:51:49.866180 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.866154 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec2d6b-b86c-4b83-92a7-3933a5d6ef46-original-pull-secret\") pod \"global-pull-secret-syncer-4wnpc\" (UID: \"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46\") " pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:49.901546 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.901517 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4wnpc" Sep 18 21:51:49.953376 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.953352 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:49.956241 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.956218 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 21:51:49.966870 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.966842 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 21:51:49.977383 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:49.977358 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrvzq\" (UniqueName: \"kubernetes.io/projected/bd0aff31-e558-4c27-aa2d-4f46e5e65b38-kube-api-access-hrvzq\") pod \"network-check-target-l94mz\" (UID: \"bd0aff31-e558-4c27-aa2d-4f46e5e65b38\") " pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:50.192019 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.191939 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-678rx\"" Sep 18 21:51:50.199317 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.199296 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:50.208475 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.208449 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4wnpc"] Sep 18 21:51:50.212313 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:51:50.212292 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ec2d6b_b86c_4b83_92a7_3933a5d6ef46.slice/crio-83bff906dc2488390ba0f460e84ce78f3c49317b0272b5ab32a40e5b284314f6 WatchSource:0}: Error finding container 83bff906dc2488390ba0f460e84ce78f3c49317b0272b5ab32a40e5b284314f6: Status 404 returned error can't find the container with id 83bff906dc2488390ba0f460e84ce78f3c49317b0272b5ab32a40e5b284314f6 Sep 18 21:51:50.365602 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.365572 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:51:50.365789 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:50.365695 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:51:50.365789 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:51:50.365787 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls podName:7249b8d1-5008-48e4-94ea-079001c7a03e nodeName:}" failed. No retries permitted until 2026-09-18 21:52:22.365771991 +0000 UTC m=+99.342833493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls") pod "dns-default-shllc" (UID: "7249b8d1-5008-48e4-94ea-079001c7a03e") : secret "dns-default-metrics-tls" not found Sep 18 21:51:50.471655 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.471571 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l94mz"] Sep 18 21:51:50.475370 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:51:50.475344 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0aff31_e558_4c27_aa2d_4f46e5e65b38.slice/crio-b7a0cab48070fc32590943c6e0abfafcd07f35ce82d7c1f5528f3e08ac0647e3 WatchSource:0}: Error finding container b7a0cab48070fc32590943c6e0abfafcd07f35ce82d7c1f5528f3e08ac0647e3: Status 404 returned error can't find the container with id b7a0cab48070fc32590943c6e0abfafcd07f35ce82d7c1f5528f3e08ac0647e3 Sep 18 21:51:50.588289 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.588255 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:50.598919 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.598892 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l94mz" event={"ID":"bd0aff31-e558-4c27-aa2d-4f46e5e65b38","Type":"ContainerStarted","Data":"b7a0cab48070fc32590943c6e0abfafcd07f35ce82d7c1f5528f3e08ac0647e3"} Sep 18 21:51:50.599993 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.599975 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4wnpc" event={"ID":"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46","Type":"ContainerStarted","Data":"83bff906dc2488390ba0f460e84ce78f3c49317b0272b5ab32a40e5b284314f6"} Sep 18 21:51:50.657408 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:50.657355 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:51:55.614277 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:55.614235 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l94mz" event={"ID":"bd0aff31-e558-4c27-aa2d-4f46e5e65b38","Type":"ContainerStarted","Data":"f8230ca23f60a8d0d7db59b2f793e76ffaca20eeab55f6b59fe589f4dd8ada94"} Sep 18 21:51:55.614761 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:55.614352 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:51:55.615679 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:55.615640 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4wnpc" event={"ID":"51ec2d6b-b86c-4b83-92a7-3933a5d6ef46","Type":"ContainerStarted","Data":"33ae6d4d8af0277933a018e7bc7b7266b156453342ce27251dac7a8813701d80"} Sep 18 21:51:55.633517 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:55.633470 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l94mz" podStartSLOduration=66.366851955 podStartE2EDuration="1m10.633455617s" totalImagesPullingTime="4.266603662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:55.632982161 +0000 UTC m=+72.610043706" watchObservedRunningTime="2026-09-18 21:51:55.633455617 +0000 UTC m=+72.610517141" Sep 18 21:51:55.649470 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:51:55.649422 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4wnpc" podStartSLOduration=66.117113449 podStartE2EDuration="1m10.649409394s" totalImagesPullingTime="4.532295945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:51:55.64861713 +0000 UTC m=+72.625678654" watchObservedRunningTime="2026-09-18 21:51:55.649409394 +0000 UTC m=+72.626470927" Sep 18 21:52:01.715507 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:01.715387 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:22.381095 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:22.381049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:52:22.381528 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:22.381169 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 21:52:22.381528 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:22.381233 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls podName:7249b8d1-5008-48e4-94ea-079001c7a03e nodeName:}" failed. No retries permitted until 2026-09-18 21:53:26.381219928 +0000 UTC m=+163.358281430 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls") pod "dns-default-shllc" (UID: "7249b8d1-5008-48e4-94ea-079001c7a03e") : secret "dns-default-metrics-tls" not found Sep 18 21:52:26.621026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:26.620996 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l94mz" Sep 18 21:52:46.992600 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:46.992566 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn"] Sep 18 21:52:46.994965 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:46.994949 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:46.997895 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:46.997862 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 18 21:52:46.998040 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:46.998010 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 18 21:52:46.998089 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:46.998011 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:52:46.998729 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:46.998711 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x24rq\"" Sep 18 21:52:46.998822 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:46.998733 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 18 21:52:47.009861 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.009841 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn"] Sep 18 21:52:47.051457 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.051416 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70626e54-50fd-4bc1-9035-3301ba72ef3a-config\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.051457 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.051456 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzrjq\" (UniqueName: \"kubernetes.io/projected/70626e54-50fd-4bc1-9035-3301ba72ef3a-kube-api-access-tzrjq\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.051688 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.051476 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70626e54-50fd-4bc1-9035-3301ba72ef3a-serving-cert\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.110824 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.110785 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-28h8h"] Sep 18 21:52:47.112507 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.112489 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.118394 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.118304 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx"] Sep 18 21:52:47.119700 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.119205 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 21:52:47.119700 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.119254 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 21:52:47.119865 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.119824 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 18 21:52:47.120717 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.120111 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hnbbj\"" Sep 18 21:52:47.122211 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.122181 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq"] Sep 18 21:52:47.122716 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.122692 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:47.122870 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.122847 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 18 21:52:47.125770 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.125748 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" Sep 18 21:52:47.126122 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.126070 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-storage-version-migrator-operator-dockercfg-8lq6p\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8lq6p\"" type="*v1.Secret" Sep 18 21:52:47.126212 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.126145 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 18 21:52:47.126986 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.126966 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8"] Sep 18 21:52:47.128555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.128539 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:47.129720 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.129694 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" Sep 18 21:52:47.130786 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.130768 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"config\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" Sep 18 21:52:47.131064 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.131046 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"volume-data-source-validator-dockercfg-k4s9t\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k4s9t\"" type="*v1.Secret" Sep 18 21:52:47.131379 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.131362 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 18 21:52:47.131467 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.131444 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 18 21:52:47.131930 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.131911 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-kube-storage-version-migrator-operator\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 18 21:52:47.136736 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.136716 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 18 21:52:47.136887 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.136870 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-flqrq\"" Sep 18 21:52:47.136958 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.136942 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 18 21:52:47.137012 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.136953 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:52:47.137383 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.137364 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 18 21:52:47.143439 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.143414 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-28h8h"] Sep 18 21:52:47.152555 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.152523 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70626e54-50fd-4bc1-9035-3301ba72ef3a-serving-cert\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.152717 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.152592 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70626e54-50fd-4bc1-9035-3301ba72ef3a-config\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.152717 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.152616 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrjq\" (UniqueName: \"kubernetes.io/projected/70626e54-50fd-4bc1-9035-3301ba72ef3a-kube-api-access-tzrjq\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.153342 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.153318 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70626e54-50fd-4bc1-9035-3301ba72ef3a-config\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.153875 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.153785 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx"] Sep 18 21:52:47.154850 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.154830 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq"] Sep 18 21:52:47.155197 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.155181 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70626e54-50fd-4bc1-9035-3301ba72ef3a-serving-cert\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.172116 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.172084 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8"] Sep 18 21:52:47.179292 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.179262 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzrjq\" (UniqueName: \"kubernetes.io/projected/70626e54-50fd-4bc1-9035-3301ba72ef3a-kube-api-access-tzrjq\") pod \"service-ca-operator-57cdc4b768-s2tqn\" (UID: \"70626e54-50fd-4bc1-9035-3301ba72ef3a\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.214759 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.214729 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d5b7ff75b-tkbrm"] Sep 18 21:52:47.216594 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.216572 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.220011 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.219986 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap" Sep 18 21:52:47.220247 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.220025 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-dockercfg-ch7xn\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ch7xn\"" type="*v1.Secret" Sep 18 21:52:47.220247 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.220052 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-ingress-cert\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret" Sep 18 21:52:47.220247 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.220178 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-metrics-certs-default\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret" Sep 18 21:52:47.220247 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.220229 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-stats-default\" is forbidden: User \"system:node:ip-10-0-143-133.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret" Sep 18 21:52:47.222752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.222646 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 18 21:52:47.222829 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.222791 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 18 21:52:47.246050 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.245968 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d5b7ff75b-tkbrm"] Sep 18 21:52:47.253151 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253121 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4npl\" (UniqueName: \"kubernetes.io/projected/26b36d06-8425-4a02-a695-66dd64d35385-kube-api-access-t4npl\") pod \"volume-data-source-validator-5c4db8bdf9-mqzrq\" (UID: \"26b36d06-8425-4a02-a695-66dd64d35385\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" Sep 18 21:52:47.253302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253162 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-tmp\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.253302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253184 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.253302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253231 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hrjq\" (UniqueName: \"kubernetes.io/projected/3e0597be-3aa5-45c1-84a3-4049e18fee3a-kube-api-access-7hrjq\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:47.253302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253248 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqpl\" (UniqueName: \"kubernetes.io/projected/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-kube-api-access-2wqpl\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.253302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253264 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:47.253302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253282 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-serving-cert\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.253302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253297 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e0597be-3aa5-45c1-84a3-4049e18fee3a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:47.253505 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253325 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-snapshots\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.253505 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253342 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.253505 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253413 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e0597be-3aa5-45c1-84a3-4049e18fee3a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:47.253505 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.253442 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2s2z\" (UniqueName: \"kubernetes.io/projected/8b3c16dd-6437-496a-b53c-d8284467b701-kube-api-access-g2s2z\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:47.303757 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.303721 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" Sep 18 21:52:47.354141 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354108 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-snapshots\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.354276 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354155 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-stats-auth\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.354276 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354211 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.354276 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354255 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e0597be-3aa5-45c1-84a3-4049e18fee3a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:47.354440 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354290 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2s2z\" (UniqueName: \"kubernetes.io/projected/8b3c16dd-6437-496a-b53c-d8284467b701-kube-api-access-g2s2z\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:47.354440 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354347 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4npl\" (UniqueName: \"kubernetes.io/projected/26b36d06-8425-4a02-a695-66dd64d35385-kube-api-access-t4npl\") pod \"volume-data-source-validator-5c4db8bdf9-mqzrq\" (UID: \"26b36d06-8425-4a02-a695-66dd64d35385\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" Sep 18 21:52:47.354440 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7trk\" (UniqueName: \"kubernetes.io/projected/d915466a-af7f-49fc-84e8-38874961c286-kube-api-access-n7trk\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.354614 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354446 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-tmp\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.354614 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354471 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.354614 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354502 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.354614 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354534 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hrjq\" (UniqueName: \"kubernetes.io/projected/3e0597be-3aa5-45c1-84a3-4049e18fee3a-kube-api-access-7hrjq\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:47.354614 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354562 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-default-certificate\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.354614 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354597 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqpl\" (UniqueName: \"kubernetes.io/projected/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-kube-api-access-2wqpl\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.354917 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354624 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:47.354917 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354682 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.354917 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354714 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-serving-cert\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.354917 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354740 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e0597be-3aa5-45c1-84a3-4049e18fee3a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:47.354917 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354870 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-snapshots\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.355152 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.354917 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.355152 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.355055 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-tmp\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.355254 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.355187 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:52:47.355310 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.355255 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls podName:8b3c16dd-6437-496a-b53c-d8284467b701 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:47.855234692 +0000 UTC m=+124.832296209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-67gx8" (UID: "8b3c16dd-6437-496a-b53c-d8284467b701") : secret "samples-operator-tls" not found Sep 18 21:52:47.356142 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.356121 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.357178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.357153 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-serving-cert\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.363861 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.363808 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2s2z\" (UniqueName: \"kubernetes.io/projected/8b3c16dd-6437-496a-b53c-d8284467b701-kube-api-access-g2s2z\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:47.369898 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.369872 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqpl\" (UniqueName: \"kubernetes.io/projected/84bca18d-4a50-4150-b87f-bed5cc8f7d6c-kube-api-access-2wqpl\") pod \"insights-operator-6f9c644dd9-28h8h\" (UID: \"84bca18d-4a50-4150-b87f-bed5cc8f7d6c\") " pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.424173 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.424125 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" Sep 18 21:52:47.450983 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.450953 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:47.456091 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.456063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.456191 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.456102 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-default-certificate\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.456191 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.456145 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.456339 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.456325 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-stats-auth\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.456419 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.456403 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7trk\" (UniqueName: \"kubernetes.io/projected/d915466a-af7f-49fc-84e8-38874961c286-kube-api-access-n7trk\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.466270 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.466242 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7trk\" (UniqueName: \"kubernetes.io/projected/d915466a-af7f-49fc-84e8-38874961c286-kube-api-access-n7trk\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:47.587178 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.587093 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn"] Sep 18 21:52:47.590025 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:52:47.589996 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70626e54_50fd_4bc1_9035_3301ba72ef3a.slice/crio-ea825f78df63e0c8b662d8fcfcc97db0fed62caea39a024423a4468ef810c309 WatchSource:0}: Error finding container ea825f78df63e0c8b662d8fcfcc97db0fed62caea39a024423a4468ef810c309: Status 404 returned error can't find the container with id ea825f78df63e0c8b662d8fcfcc97db0fed62caea39a024423a4468ef810c309 Sep 18 21:52:47.714585 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.714559 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-28h8h"] Sep 18 21:52:47.716848 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:52:47.716822 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84bca18d_4a50_4150_b87f_bed5cc8f7d6c.slice/crio-506d5485bae2f1173e2c79fd664a915ea713656f8043a25696d826e2a69a5fcc WatchSource:0}: Error finding container 506d5485bae2f1173e2c79fd664a915ea713656f8043a25696d826e2a69a5fcc: Status 404 returned error can't find the container with id 506d5485bae2f1173e2c79fd664a915ea713656f8043a25696d826e2a69a5fcc Sep 18 21:52:47.739123 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.736388 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" event={"ID":"70626e54-50fd-4bc1-9035-3301ba72ef3a","Type":"ContainerStarted","Data":"ea825f78df63e0c8b662d8fcfcc97db0fed62caea39a024423a4468ef810c309"} Sep 18 21:52:47.740403 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.740376 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" event={"ID":"84bca18d-4a50-4150-b87f-bed5cc8f7d6c","Type":"ContainerStarted","Data":"506d5485bae2f1173e2c79fd664a915ea713656f8043a25696d826e2a69a5fcc"} Sep 18 21:52:47.859484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.859447 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:47.859637 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.859602 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:52:47.859700 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:47.859690 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls podName:8b3c16dd-6437-496a-b53c-d8284467b701 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:48.859649872 +0000 UTC m=+125.836711374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-67gx8" (UID: "8b3c16dd-6437-496a-b53c-d8284467b701") : secret "samples-operator-tls" not found Sep 18 21:52:47.969679 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.969644 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:52:47.988449 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:47.988423 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k4s9t\"" Sep 18 21:52:48.171403 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.171320 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8lq6p\"" Sep 18 21:52:48.226466 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.226434 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 18 21:52:48.269253 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.269000 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 18 21:52:48.276557 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.276522 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e0597be-3aa5-45c1-84a3-4049e18fee3a-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:48.355370 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.355330 2553 secret.go:189] Couldn't get secret openshift-kube-storage-version-migrator-operator/serving-cert: failed to sync secret cache: timed out waiting for the condition Sep 18 21:52:48.355557 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.355444 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e0597be-3aa5-45c1-84a3-4049e18fee3a-serving-cert podName:3e0597be-3aa5-45c1-84a3-4049e18fee3a nodeName:}" failed. No retries permitted until 2026-09-18 21:52:48.855418809 +0000 UTC m=+125.832480332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/3e0597be-3aa5-45c1-84a3-4049e18fee3a-serving-cert") pod "kube-storage-version-migrator-operator-55889f7b47-b97hx" (UID: "3e0597be-3aa5-45c1-84a3-4049e18fee3a") : failed to sync secret cache: timed out waiting for the condition Sep 18 21:52:48.364114 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.364077 2553 projected.go:291] Couldn't get configMap openshift-cluster-storage-operator/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Sep 18 21:52:48.364114 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.364121 2553 projected.go:196] Error preparing data for projected volume kube-api-access-t4npl for pod openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq: failed to sync configmap cache: timed out waiting for the condition Sep 18 21:52:48.364349 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.364178 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26b36d06-8425-4a02-a695-66dd64d35385-kube-api-access-t4npl podName:26b36d06-8425-4a02-a695-66dd64d35385 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:48.86416241 +0000 UTC m=+125.841223912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t4npl" (UniqueName: "kubernetes.io/projected/26b36d06-8425-4a02-a695-66dd64d35385-kube-api-access-t4npl") pod "volume-data-source-validator-5c4db8bdf9-mqzrq" (UID: "26b36d06-8425-4a02-a695-66dd64d35385") : failed to sync configmap cache: timed out waiting for the condition Sep 18 21:52:48.415174 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.415141 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ch7xn\"" Sep 18 21:52:48.433699 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.433600 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 18 21:52:48.439836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.439805 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-stats-auth\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:48.457014 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.456978 2553 configmap.go:193] Couldn't get configMap openshift-ingress/service-ca-bundle: failed to sync configmap cache: timed out waiting for the condition Sep 18 21:52:48.457014 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.457024 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: failed to sync secret cache: timed out waiting for the condition Sep 18 21:52:48.457319 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.456991 2553 secret.go:189] Couldn't get secret openshift-ingress/default-ingress-cert: failed to sync secret cache: timed out waiting for the condition Sep 18 21:52:48.457319 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.457099 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:48.957077557 +0000 UTC m=+125.934139070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : failed to sync configmap cache: timed out waiting for the condition Sep 18 21:52:48.457319 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.457120 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-default-certificate podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:48.957109196 +0000 UTC m=+125.934170701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "default-certificate" (UniqueName: "kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-default-certificate") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : failed to sync secret cache: timed out waiting for the condition Sep 18 21:52:48.457319 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.457139 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:48.957131305 +0000 UTC m=+125.934192823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : failed to sync secret cache: timed out waiting for the condition Sep 18 21:52:48.460312 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.460260 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 18 21:52:48.656604 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.656568 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 18 21:52:48.680222 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.680185 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:48.688220 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.688152 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 18 21:52:48.692723 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.692697 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 18 21:52:48.697634 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.697606 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hrjq\" (UniqueName: \"kubernetes.io/projected/3e0597be-3aa5-45c1-84a3-4049e18fee3a-kube-api-access-7hrjq\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:48.780163 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.780131 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 18 21:52:48.799170 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.799138 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 18 21:52:48.869458 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.868933 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4npl\" (UniqueName: \"kubernetes.io/projected/26b36d06-8425-4a02-a695-66dd64d35385-kube-api-access-t4npl\") pod \"volume-data-source-validator-5c4db8bdf9-mqzrq\" (UID: \"26b36d06-8425-4a02-a695-66dd64d35385\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" Sep 18 21:52:48.869458 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.869030 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:48.869458 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.869106 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e0597be-3aa5-45c1-84a3-4049e18fee3a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:48.869458 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.869255 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:52:48.869458 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.869332 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls podName:8b3c16dd-6437-496a-b53c-d8284467b701 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:50.869315673 +0000 UTC m=+127.846377176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-67gx8" (UID: "8b3c16dd-6437-496a-b53c-d8284467b701") : secret "samples-operator-tls" not found Sep 18 21:52:48.871738 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.871716 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4npl\" (UniqueName: \"kubernetes.io/projected/26b36d06-8425-4a02-a695-66dd64d35385-kube-api-access-t4npl\") pod \"volume-data-source-validator-5c4db8bdf9-mqzrq\" (UID: \"26b36d06-8425-4a02-a695-66dd64d35385\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" Sep 18 21:52:48.871835 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.871735 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e0597be-3aa5-45c1-84a3-4049e18fee3a-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-b97hx\" (UID: \"3e0597be-3aa5-45c1-84a3-4049e18fee3a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:48.931935 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.931891 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" Sep 18 21:52:48.938819 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.938750 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" Sep 18 21:52:48.970026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.969987 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:48.970199 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.970034 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-default-certificate\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:48.970199 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.970169 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:48.970199 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.970184 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:49.970164083 +0000 UTC m=+126.947225587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : configmap references non-existent config key: service-ca.crt Sep 18 21:52:48.970384 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.970323 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 21:52:48.970384 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:48.970381 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:49.970366754 +0000 UTC m=+126.947428258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : secret "router-metrics-certs-default" not found Sep 18 21:52:48.972783 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:48.972758 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-default-certificate\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:49.977468 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:49.977428 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:49.977915 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:49.977549 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:49.977915 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:49.977602 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 21:52:49.977915 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:49.977698 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:51.977677643 +0000 UTC m=+128.954739160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : secret "router-metrics-certs-default" not found Sep 18 21:52:49.977915 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:49.977720 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:51.977708184 +0000 UTC m=+128.954769689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : configmap references non-existent config key: service-ca.crt Sep 18 21:52:50.103567 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.103349 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq"] Sep 18 21:52:50.105599 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.105560 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx"] Sep 18 21:52:50.106241 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:52:50.106214 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b36d06_8425_4a02_a695_66dd64d35385.slice/crio-8403ea4ff0613111802bc58229e208ef5912570b942b7854f17cbc6318aacc70 WatchSource:0}: Error finding container 8403ea4ff0613111802bc58229e208ef5912570b942b7854f17cbc6318aacc70: Status 404 returned error can't find the container with id 8403ea4ff0613111802bc58229e208ef5912570b942b7854f17cbc6318aacc70 Sep 18 21:52:50.109190 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:52:50.109170 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0597be_3aa5_45c1_84a3_4049e18fee3a.slice/crio-db3399bd25fda91be5dd5f2351abffddcf6752eed0766817e2c54affb83a2c2c WatchSource:0}: Error finding container db3399bd25fda91be5dd5f2351abffddcf6752eed0766817e2c54affb83a2c2c: Status 404 returned error can't find the container with id db3399bd25fda91be5dd5f2351abffddcf6752eed0766817e2c54affb83a2c2c Sep 18 21:52:50.752302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.751770 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" event={"ID":"70626e54-50fd-4bc1-9035-3301ba72ef3a","Type":"ContainerStarted","Data":"d4a711125faa729af2f08d4675bd9a85507a043dbbe8e2bb59b266a0761c692a"} Sep 18 21:52:50.753435 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.753407 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" event={"ID":"26b36d06-8425-4a02-a695-66dd64d35385","Type":"ContainerStarted","Data":"8403ea4ff0613111802bc58229e208ef5912570b942b7854f17cbc6318aacc70"} Sep 18 21:52:50.755841 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.755812 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" event={"ID":"84bca18d-4a50-4150-b87f-bed5cc8f7d6c","Type":"ContainerStarted","Data":"a56e90407f0628380ac4d3d9ad857e4ffa227a0e5c6ca01e8f77961d82b2c1dc"} Sep 18 21:52:50.757915 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.757887 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" event={"ID":"3e0597be-3aa5-45c1-84a3-4049e18fee3a","Type":"ContainerStarted","Data":"db3399bd25fda91be5dd5f2351abffddcf6752eed0766817e2c54affb83a2c2c"} Sep 18 21:52:50.772794 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.772407 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" podStartSLOduration=2.535224035 podStartE2EDuration="4.772387971s" totalImagesPullingTime="2.237163936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:50.770965737 +0000 UTC m=+127.748027284" watchObservedRunningTime="2026-09-18 21:52:50.772387971 +0000 UTC m=+127.749449495" Sep 18 21:52:50.795358 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.794590 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" podStartSLOduration=1.679974404 podStartE2EDuration="3.794568057s" totalImagesPullingTime="2.114593653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:50.793254476 +0000 UTC m=+127.770316029" watchObservedRunningTime="2026-09-18 21:52:50.794568057 +0000 UTC m=+127.771629594" Sep 18 21:52:50.886275 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:50.886235 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:50.887500 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:50.887340 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:52:50.887500 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:50.887406 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls podName:8b3c16dd-6437-496a-b53c-d8284467b701 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:54.887388675 +0000 UTC m=+131.864450180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-67gx8" (UID: "8b3c16dd-6437-496a-b53c-d8284467b701") : secret "samples-operator-tls" not found Sep 18 21:52:51.028281 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.028201 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j5czk"] Sep 18 21:52:51.031452 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.030779 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.034011 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.033564 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 21:52:51.034011 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.033582 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9mnft\"" Sep 18 21:52:51.034011 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.033852 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 21:52:51.041509 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.041431 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:51.045812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.045781 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j5czk"] Sep 18 21:52:51.087946 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.087909 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ecb088c4-7423-42b0-bb4f-586085cfee17-crio-socket\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.087946 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.087945 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.088203 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.088033 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldjl7\" (UniqueName: \"kubernetes.io/projected/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-api-access-ldjl7\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.088203 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.088099 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecb088c4-7423-42b0-bb4f-586085cfee17-data-volume\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.088203 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.088185 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.104101 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.103996 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:51.188876 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.188839 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.189076 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.188909 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ecb088c4-7423-42b0-bb4f-586085cfee17-crio-socket\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.189076 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.188929 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.189076 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.189062 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:51.189244 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.189124 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldjl7\" (UniqueName: \"kubernetes.io/projected/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-api-access-ldjl7\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.189244 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.189141 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:51.689117869 +0000 UTC m=+128.666179376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:51.189244 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.189182 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:51.189244 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.189191 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecb088c4-7423-42b0-bb4f-586085cfee17-data-volume\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.189244 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.189244 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:51.689226286 +0000 UTC m=+128.666287793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : configmap "kube-rbac-proxy" not found Sep 18 21:52:51.189497 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.189306 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ecb088c4-7423-42b0-bb4f-586085cfee17-crio-socket\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.189549 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.189515 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecb088c4-7423-42b0-bb4f-586085cfee17-data-volume\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.209200 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.209158 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldjl7\" (UniqueName: \"kubernetes.io/projected/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-api-access-ldjl7\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.564907 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.564799 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:51.649794 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.649743 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:51.693759 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.693721 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.693935 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.693856 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:51.693935 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.693860 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:51.694066 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.693958 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:52.693938404 +0000 UTC m=+129.670999909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : configmap "kube-rbac-proxy" not found Sep 18 21:52:51.694066 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.694008 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:51.694161 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.694073 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:52.694056478 +0000 UTC m=+129.671117979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:51.764139 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.764092 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" event={"ID":"26b36d06-8425-4a02-a695-66dd64d35385","Type":"ContainerStarted","Data":"77d2c7ddfc66f75ec71e8e9c8fa1339d334194f95ed10f3334c1041ce722e98f"} Sep 18 21:52:51.786191 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.786131 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-mqzrq" podStartSLOduration=3.65787885 podStartE2EDuration="4.786113774s" totalImagesPullingTime="1.128234924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:51.784180192 +0000 UTC m=+128.761241757" watchObservedRunningTime="2026-09-18 21:52:51.786113774 +0000 UTC m=+128.763175298" Sep 18 21:52:51.890588 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.890540 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:51.992003 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.991967 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:51.996711 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.996677 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:51.996877 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:51.996756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:51.996877 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.996766 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 21:52:51.996877 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.996828 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:55.996812961 +0000 UTC m=+132.973874469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : secret "router-metrics-certs-default" not found Sep 18 21:52:51.996877 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:51.996873 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:55.996861589 +0000 UTC m=+132.973923091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : configmap references non-existent config key: service-ca.crt Sep 18 21:52:52.098778 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:52.098739 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:52.324148 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:52.324051 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:52.407445 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:52.407384 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:52.703046 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:52.703015 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:52.703240 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:52.703065 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:52.703240 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:52.703149 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:52.703240 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:52.703182 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:52.703240 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:52.703202 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:54.703187296 +0000 UTC m=+131.680248798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : configmap "kube-rbac-proxy" not found Sep 18 21:52:52.703240 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:52.703241 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:54.70322724 +0000 UTC m=+131.680288746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:52.768608 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:52.768570 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" event={"ID":"3e0597be-3aa5-45c1-84a3-4049e18fee3a","Type":"ContainerStarted","Data":"1e19570581664bfaa7c35f50c2934691168403a738232baafc33feec6b25284d"} Sep 18 21:52:52.789305 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:52.789251 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" podStartSLOduration=3.893322895 podStartE2EDuration="5.789233756s" totalImagesPullingTime="1.895910861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:52.788525893 +0000 UTC m=+129.765587436" watchObservedRunningTime="2026-09-18 21:52:52.789233756 +0000 UTC m=+129.766295279" Sep 18 21:52:52.972087 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:52.972003 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dkbkd_e07c0afd-584c-49f8-a8d0-46497506f2b6/dns-node-resolver/0.log" Sep 18 21:52:53.775528 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.775320 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:53.878056 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.878017 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:53.896658 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.896622 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9cztj"] Sep 18 21:52:53.900087 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.900069 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:53.909498 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.909476 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 21:52:53.910297 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.910279 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 21:52:53.910386 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.910301 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-z6wdl\"" Sep 18 21:52:53.910386 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.910324 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 21:52:53.911773 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.911754 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 21:52:53.912927 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.912910 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:52:53.913106 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:53.913090 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 21:52:53.913176 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:53.913157 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs podName:2de0f77b-b8af-4621-99bb-86b1167904c1 nodeName:}" failed. No retries permitted until 2026-09-18 21:54:55.913137129 +0000 UTC m=+252.890198648 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs") pod "network-metrics-daemon-ndv9n" (UID: "2de0f77b-b8af-4621-99bb-86b1167904c1") : secret "metrics-daemon-secret" not found Sep 18 21:52:53.918361 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.918341 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9cztj"] Sep 18 21:52:53.969380 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:53.969351 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:54.014154 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.014119 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b377f3df-ffa9-472d-b171-52d567b3cce0-signing-key\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.014154 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.014152 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hccvl\" (UniqueName: \"kubernetes.io/projected/b377f3df-ffa9-472d-b171-52d567b3cce0-kube-api-access-hccvl\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.014395 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.014227 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b377f3df-ffa9-472d-b171-52d567b3cce0-signing-cabundle\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.115562 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.115522 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b377f3df-ffa9-472d-b171-52d567b3cce0-signing-key\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.115562 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.115560 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hccvl\" (UniqueName: \"kubernetes.io/projected/b377f3df-ffa9-472d-b171-52d567b3cce0-kube-api-access-hccvl\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.115856 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.115621 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b377f3df-ffa9-472d-b171-52d567b3cce0-signing-cabundle\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.116397 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.116371 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b377f3df-ffa9-472d-b171-52d567b3cce0-signing-cabundle\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.117896 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.117874 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b377f3df-ffa9-472d-b171-52d567b3cce0-signing-key\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.123578 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.123558 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hccvl\" (UniqueName: \"kubernetes.io/projected/b377f3df-ffa9-472d-b171-52d567b3cce0-kube-api-access-hccvl\") pod \"service-ca-55f6fc7b86-9cztj\" (UID: \"b377f3df-ffa9-472d-b171-52d567b3cce0\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.172921 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.172892 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kf47m_1b80f305-7db1-4458-9919-4a956ac98551/node-ca/0.log" Sep 18 21:52:54.209302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.209260 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" Sep 18 21:52:54.496361 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.496288 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9cztj"] Sep 18 21:52:54.499220 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:52:54.499198 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb377f3df_ffa9_472d_b171_52d567b3cce0.slice/crio-cbbc7a742756cc9eb9f6c2e4adbe4faf9d3eabdd54889121a0fe736d673f834e WatchSource:0}: Error finding container cbbc7a742756cc9eb9f6c2e4adbe4faf9d3eabdd54889121a0fe736d673f834e: Status 404 returned error can't find the container with id cbbc7a742756cc9eb9f6c2e4adbe4faf9d3eabdd54889121a0fe736d673f834e Sep 18 21:52:54.722114 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.722080 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:54.722332 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.722177 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:54.722332 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:54.722238 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:54.722332 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:54.722277 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:54.722332 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:54.722319 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:58.722299121 +0000 UTC m=+135.699360643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : configmap "kube-rbac-proxy" not found Sep 18 21:52:54.722553 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:54.722338 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:52:58.722329735 +0000 UTC m=+135.699391239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:54.773022 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.772942 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ksgsm_1f4ee511-aedd-4e1d-8a06-f427ca0f2f03/serve-healthcheck-canary/0.log" Sep 18 21:52:54.781037 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.781006 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" event={"ID":"b377f3df-ffa9-472d-b171-52d567b3cce0","Type":"ContainerStarted","Data":"404a971e285f68c55942f8701fa67c9bb1f39cfb9d97f86eea698cbb841afc15"} Sep 18 21:52:54.781487 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.781052 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" event={"ID":"b377f3df-ffa9-472d-b171-52d567b3cce0","Type":"ContainerStarted","Data":"cbbc7a742756cc9eb9f6c2e4adbe4faf9d3eabdd54889121a0fe736d673f834e"} Sep 18 21:52:54.801035 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.800969 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-9cztj" podStartSLOduration=1.80094436 podStartE2EDuration="1.80094436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:52:54.799964464 +0000 UTC m=+131.777026008" watchObservedRunningTime="2026-09-18 21:52:54.80094436 +0000 UTC m=+131.778005886" Sep 18 21:52:54.924478 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.924439 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:52:54.924683 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:54.924645 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 21:52:54.924747 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:54.924735 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls podName:8b3c16dd-6437-496a-b53c-d8284467b701 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:02.9247154 +0000 UTC m=+139.901776919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-67gx8" (UID: "8b3c16dd-6437-496a-b53c-d8284467b701") : secret "samples-operator-tls" not found Sep 18 21:52:54.989441 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:54.989396 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:56.034396 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:56.034359 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:56.034852 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:56.034540 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:52:56.034852 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:56.034551 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:04.034532139 +0000 UTC m=+141.011593662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : configmap references non-existent config key: service-ca.crt Sep 18 21:52:56.034852 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:56.034656 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 18 21:52:56.034852 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:56.034721 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs podName:d915466a-af7f-49fc-84e8-38874961c286 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:04.034709798 +0000 UTC m=+141.011771304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs") pod "router-default-6d5b7ff75b-tkbrm" (UID: "d915466a-af7f-49fc-84e8-38874961c286") : secret "router-metrics-certs-default" not found Sep 18 21:52:56.309192 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:56.309097 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:56.479206 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:56.479167 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:56.714344 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:56.714301 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:56.839124 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:56.839076 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:56.944812 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:56.944767 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:57.048876 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:57.048768 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:57.222977 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:57.222938 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:57.417227 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:57.417193 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:58.004261 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:58.004226 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:58.104504 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:58.104471 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:58.604359 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:58.604330 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:58.755854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:58.755816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:58.756052 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:58.755881 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:52:58.756052 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:58.755966 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 21:52:58.756052 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:58.755980 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 21:52:58.756052 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:58.756032 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:06.756016758 +0000 UTC m=+143.733078259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : secret "insights-runtime-extractor-tls" not found Sep 18 21:52:58.756052 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:52:58.756050 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm podName:ecb088c4-7423-42b0-bb4f-586085cfee17 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:06.756042254 +0000 UTC m=+143.733103755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j5czk" (UID: "ecb088c4-7423-42b0-bb4f-586085cfee17") : configmap "kube-rbac-proxy" not found Sep 18 21:52:59.023544 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:59.023464 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:59.409847 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:59.409801 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:52:59.604162 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:52:59.604126 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:00.022854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:00.022811 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:00.212881 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:00.212845 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:00.502089 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:00.502057 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:00.624554 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:00.624517 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:01.013048 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:01.013014 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:01.205363 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:01.205326 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:01.818868 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:01.818831 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:02.022577 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:02.022544 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:02.377988 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:02.377939 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:02.619732 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:02.619696 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:02.992962 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:02.992923 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:53:02.995435 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:02.995408 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b3c16dd-6437-496a-b53c-d8284467b701-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-67gx8\" (UID: \"8b3c16dd-6437-496a-b53c-d8284467b701\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:53:03.043791 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:03.043748 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" Sep 18 21:53:03.234566 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:03.234522 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:03.319461 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:03.319373 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8"] Sep 18 21:53:03.425803 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:03.425773 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:03.810216 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:03.810174 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" event={"ID":"8b3c16dd-6437-496a-b53c-d8284467b701","Type":"ContainerStarted","Data":"ecb190978395dca267a8bb7de83b0a8ce93169a1a00fd871d08113171db19960"} Sep 18 21:53:03.822509 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:03.822477 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:04.013732 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.013691 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:04.102317 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.102284 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:04.102501 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.102385 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:04.103173 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.103149 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d915466a-af7f-49fc-84e8-38874961c286-service-ca-bundle\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:04.105333 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.105286 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d915466a-af7f-49fc-84e8-38874961c286-metrics-certs\") pod \"router-default-6d5b7ff75b-tkbrm\" (UID: \"d915466a-af7f-49fc-84e8-38874961c286\") " pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:04.243327 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.243295 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:04.325422 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.325382 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:04.623258 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.623225 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d5b7ff75b-tkbrm"] Sep 18 21:53:04.628050 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:04.628012 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:05.008727 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.008692 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:05.010204 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:05.010172 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd915466a_af7f_49fc_84e8_38874961c286.slice/crio-b6c6df8305074c6fbc384cfc952ede18c67f1242a21f87fc49401db497f585bf WatchSource:0}: Error finding container b6c6df8305074c6fbc384cfc952ede18c67f1242a21f87fc49401db497f585bf: Status 404 returned error can't find the container with id b6c6df8305074c6fbc384cfc952ede18c67f1242a21f87fc49401db497f585bf Sep 18 21:53:05.206466 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.206409 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:05.406933 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.406895 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:05.554286 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.554247 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:05.654421 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.654389 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:05.817986 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.817884 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" event={"ID":"8b3c16dd-6437-496a-b53c-d8284467b701","Type":"ContainerStarted","Data":"1396fe5c070e247246c4b45e5dacd6646ad114947ebb8220c88adbf347cf6fee"} Sep 18 21:53:05.817986 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.817976 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" event={"ID":"8b3c16dd-6437-496a-b53c-d8284467b701","Type":"ContainerStarted","Data":"ea198e6c178b454cbf40e0995517af4195531c237b012e20ad2fee662505ae48"} Sep 18 21:53:05.819285 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.819262 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" event={"ID":"d915466a-af7f-49fc-84e8-38874961c286","Type":"ContainerStarted","Data":"9170fa87091a5c3aabbd75415a6d6020c3bcb22cbb8ff04228e2ca2bbb22a63e"} Sep 18 21:53:05.819354 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.819304 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" event={"ID":"d915466a-af7f-49fc-84e8-38874961c286","Type":"ContainerStarted","Data":"b6c6df8305074c6fbc384cfc952ede18c67f1242a21f87fc49401db497f585bf"} Sep 18 21:53:05.839252 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.839195 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-67gx8" podStartSLOduration=17.146798932 podStartE2EDuration="18.839176231s" totalImagesPullingTime="1.692377299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:05.837996609 +0000 UTC m=+142.815058164" watchObservedRunningTime="2026-09-18 21:53:05.839176231 +0000 UTC m=+142.816237755" Sep 18 21:53:05.865135 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:05.865080 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" podStartSLOduration=18.865062316 podStartE2EDuration="18.865062316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:05.864555457 +0000 UTC m=+142.841617052" watchObservedRunningTime="2026-09-18 21:53:05.865062316 +0000 UTC m=+142.842123841" Sep 18 21:53:06.205711 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.205676 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:06.326238 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.326207 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:06.328801 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.328779 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:06.617964 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.617928 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:06.822435 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.822393 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:06.823586 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.823566 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d5b7ff75b-tkbrm" Sep 18 21:53:06.826945 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.826928 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:53:06.827009 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.826979 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:53:06.827596 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.827573 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecb088c4-7423-42b0-bb4f-586085cfee17-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:53:06.829245 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.829225 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecb088c4-7423-42b0-bb4f-586085cfee17-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j5czk\" (UID: \"ecb088c4-7423-42b0-bb4f-586085cfee17\") " pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:53:06.864521 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.864480 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:06.945581 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:06.945492 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j5czk" Sep 18 21:53:07.024360 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:07.024320 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:07.214323 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:07.214241 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:07.223547 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:07.223518 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j5czk"] Sep 18 21:53:07.227034 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:07.226996 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb088c4_7423_42b0_bb4f_586085cfee17.slice/crio-0c01641f7663ce844cdf3466df40f2acbdd83ce738de23301134765cd1546c93 WatchSource:0}: Error finding container 0c01641f7663ce844cdf3466df40f2acbdd83ce738de23301134765cd1546c93: Status 404 returned error can't find the container with id 0c01641f7663ce844cdf3466df40f2acbdd83ce738de23301134765cd1546c93 Sep 18 21:53:07.403011 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:07.402976 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:07.827367 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:07.827335 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5czk" event={"ID":"ecb088c4-7423-42b0-bb4f-586085cfee17","Type":"ContainerStarted","Data":"0492243430dc73737eb29ac3d1570297a1424a3bb3acc5e8ca3ad451085474d2"} Sep 18 21:53:07.827548 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:07.827389 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5czk" event={"ID":"ecb088c4-7423-42b0-bb4f-586085cfee17","Type":"ContainerStarted","Data":"0c01641f7663ce844cdf3466df40f2acbdd83ce738de23301134765cd1546c93"} Sep 18 21:53:08.834105 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:08.834068 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5czk" event={"ID":"ecb088c4-7423-42b0-bb4f-586085cfee17","Type":"ContainerStarted","Data":"892fc5e2b564a28919b77c71871143f2303801be913204c85ac6360fe3c05a67"} Sep 18 21:53:09.839515 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:09.839471 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j5czk" event={"ID":"ecb088c4-7423-42b0-bb4f-586085cfee17","Type":"ContainerStarted","Data":"af735eb1a1f5234ccaef398a5c8c902df434cec6a5b071dccb7433c2422a0ff2"} Sep 18 21:53:09.867145 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:09.867072 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j5czk" podStartSLOduration=17.06506745 podStartE2EDuration="18.867055625s" totalImagesPullingTime="1.801988175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 21:52:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:09.865340719 +0000 UTC m=+146.842402242" watchObservedRunningTime="2026-09-18 21:53:09.867055625 +0000 UTC m=+146.844117148" Sep 18 21:53:13.099766 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:13.099651 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:13.246983 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:13.246940 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:13.438217 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:13.438182 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:14.617469 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:14.617440 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:14.744572 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:14.744527 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:15.608606 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.608574 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:15.675114 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.675081 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb"] Sep 18 21:53:15.680051 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.680022 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.683244 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.683221 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hrlml\"" Sep 18 21:53:15.683370 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.683223 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 21:53:15.683433 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.683415 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 21:53:15.684217 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.684199 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 21:53:15.684326 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.684201 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 21:53:15.684326 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.684220 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 21:53:15.689184 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.689163 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb"] Sep 18 21:53:15.731119 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.731086 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:15.797127 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.797088 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjl68\" (UniqueName: \"kubernetes.io/projected/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-kube-api-access-mjl68\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.797285 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.797132 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.797285 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.797211 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.797285 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.797238 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.898359 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.898273 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjl68\" (UniqueName: \"kubernetes.io/projected/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-kube-api-access-mjl68\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.898359 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.898307 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.898536 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:53:15.898476 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 18 21:53:15.898536 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:53:15.898531 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls podName:04f39d74-6eff-4f3f-b5e9-cd51c86de16f nodeName:}" failed. No retries permitted until 2026-09-18 21:53:16.398517444 +0000 UTC m=+153.375578946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-lnzvb" (UID: "04f39d74-6eff-4f3f-b5e9-cd51c86de16f") : secret "prometheus-operator-tls" not found Sep 18 21:53:15.898642 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.898569 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.898642 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.898617 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.899227 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.899207 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.900941 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.900924 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:15.911564 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:15.911538 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjl68\" (UniqueName: \"kubernetes.io/projected/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-kube-api-access-mjl68\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:16.402473 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:16.402436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:16.402658 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:53:16.402549 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 18 21:53:16.402658 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:53:16.402629 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls podName:04f39d74-6eff-4f3f-b5e9-cd51c86de16f nodeName:}" failed. No retries permitted until 2026-09-18 21:53:17.402612455 +0000 UTC m=+154.379673958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-lnzvb" (UID: "04f39d74-6eff-4f3f-b5e9-cd51c86de16f") : secret "prometheus-operator-tls" not found Sep 18 21:53:16.507213 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:16.507175 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:17.408404 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:17.408368 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:17.410756 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:17.410737 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/04f39d74-6eff-4f3f-b5e9-cd51c86de16f-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lnzvb\" (UID: \"04f39d74-6eff-4f3f-b5e9-cd51c86de16f\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:17.489720 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:17.489654 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" Sep 18 21:53:17.762994 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:17.762967 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb"] Sep 18 21:53:17.765066 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:17.765037 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f39d74_6eff_4f3f_b5e9_cd51c86de16f.slice/crio-b83b272d1cca26a552c91945339209f7c43d42c9b041ab0bee0168f77f08468c WatchSource:0}: Error finding container b83b272d1cca26a552c91945339209f7c43d42c9b041ab0bee0168f77f08468c: Status 404 returned error can't find the container with id b83b272d1cca26a552c91945339209f7c43d42c9b041ab0bee0168f77f08468c Sep 18 21:53:17.865948 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:17.865912 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" event={"ID":"04f39d74-6eff-4f3f-b5e9-cd51c86de16f","Type":"ContainerStarted","Data":"b83b272d1cca26a552c91945339209f7c43d42c9b041ab0bee0168f77f08468c"} Sep 18 21:53:19.274426 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:19.274336 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:19.875321 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:19.875289 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" event={"ID":"04f39d74-6eff-4f3f-b5e9-cd51c86de16f","Type":"ContainerStarted","Data":"97fe913bae1b763a57845ac8a88338c45fe347c919990d56737f2feeb36319cd"} Sep 18 21:53:19.875491 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:19.875338 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" event={"ID":"04f39d74-6eff-4f3f-b5e9-cd51c86de16f","Type":"ContainerStarted","Data":"6de37e6d709cca989eaa8363bdbce3be773a54af46d60e5de743322c15a8d3f7"} Sep 18 21:53:19.899431 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:19.899382 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lnzvb" podStartSLOduration=3.712803358 podStartE2EDuration="4.899365244s" totalImagesPullingTime="1.186561886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:19.8977727 +0000 UTC m=+156.874834244" watchObservedRunningTime="2026-09-18 21:53:19.899365244 +0000 UTC m=+156.876426767" Sep 18 21:53:21.492899 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:53:21.492863 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-shllc" podUID="7249b8d1-5008-48e4-94ea-079001c7a03e" Sep 18 21:53:21.827078 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:21.826995 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:21.882579 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:21.882554 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-shllc" Sep 18 21:53:22.040248 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.040209 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:22.116927 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.116896 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb"] Sep 18 21:53:22.120360 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.120342 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.127968 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.127938 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 21:53:22.128694 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.128645 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 21:53:22.129129 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.128978 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tcdzh\"" Sep 18 21:53:22.133331 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.133309 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb"] Sep 18 21:53:22.141633 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.141604 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a249aae-5477-4870-94f7-9d3709f045e8-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.141770 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.141647 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a249aae-5477-4870-94f7-9d3709f045e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.141770 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.141702 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbj2\" (UniqueName: \"kubernetes.io/projected/4a249aae-5477-4870-94f7-9d3709f045e8-kube-api-access-5rbj2\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.141770 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.141759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a249aae-5477-4870-94f7-9d3709f045e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.156487 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.156465 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-pflhp"] Sep 18 21:53:22.159631 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.159615 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.162354 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.162326 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vkz28\"" Sep 18 21:53:22.162520 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.162499 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 21:53:22.162578 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.162556 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 21:53:22.162616 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.162588 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 21:53:22.164422 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.164402 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:22.172236 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.172218 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qqwb4"] Sep 18 21:53:22.175296 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.175283 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.177410 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.177386 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-pflhp"] Sep 18 21:53:22.177565 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.177543 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 21:53:22.177700 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.177619 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 21:53:22.177700 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.177630 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m626z\"" Sep 18 21:53:22.178579 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.178559 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 21:53:22.243139 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243100 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-wtmp\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.243139 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243137 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.243393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243162 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.243393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243218 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-tls\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.243393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243262 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a249aae-5477-4870-94f7-9d3709f045e8-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.243393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243282 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xslvd\" (UniqueName: \"kubernetes.io/projected/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-api-access-xslvd\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.243393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243301 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a249aae-5477-4870-94f7-9d3709f045e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.243393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243322 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-sys\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.243393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243346 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.243393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-textfile\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243408 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbj2\" (UniqueName: \"kubernetes.io/projected/4a249aae-5477-4870-94f7-9d3709f045e8-kube-api-access-5rbj2\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243451 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243475 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nfdn\" (UniqueName: \"kubernetes.io/projected/54f00258-b97d-41e8-8c39-4d489f18bc73-kube-api-access-6nfdn\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243502 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a249aae-5477-4870-94f7-9d3709f045e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243533 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243581 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54f00258-b97d-41e8-8c39-4d489f18bc73-metrics-client-ca\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243605 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243639 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.243836 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.243679 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-root\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.244277 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.244044 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a249aae-5477-4870-94f7-9d3709f045e8-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.245794 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.245769 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a249aae-5477-4870-94f7-9d3709f045e8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.245907 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.245852 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a249aae-5477-4870-94f7-9d3709f045e8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.254224 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.254200 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbj2\" (UniqueName: \"kubernetes.io/projected/4a249aae-5477-4870-94f7-9d3709f045e8-kube-api-access-5rbj2\") pod \"openshift-state-metrics-86c5bc79d6-flfrb\" (UID: \"4a249aae-5477-4870-94f7-9d3709f045e8\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.264942 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.264901 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:22.344506 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344459 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.344506 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344504 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-tls\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344537 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xslvd\" (UniqueName: \"kubernetes.io/projected/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-api-access-xslvd\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344562 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-sys\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344585 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344607 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-textfile\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344649 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344693 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nfdn\" (UniqueName: \"kubernetes.io/projected/54f00258-b97d-41e8-8c39-4d489f18bc73-kube-api-access-6nfdn\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344721 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344692 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-sys\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.344807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344761 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54f00258-b97d-41e8-8c39-4d489f18bc73-metrics-client-ca\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344852 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344880 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-root\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344937 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-wtmp\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344967 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.344987 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-textfile\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.345031 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.345097 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-root\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345221 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.345214 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-wtmp\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345658 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.345229 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-accelerators-collector-config\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345658 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.345344 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54f00258-b97d-41e8-8c39-4d489f18bc73-metrics-client-ca\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.345797 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.345694 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.345916 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.345897 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.347436 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.347382 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.347559 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.347537 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.347642 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.347625 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54f00258-b97d-41e8-8c39-4d489f18bc73-node-exporter-tls\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.347759 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.347742 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.357700 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.357633 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xslvd\" (UniqueName: \"kubernetes.io/projected/1f78768e-a13c-4f1a-92ab-6d65b9f296fb-kube-api-access-xslvd\") pod \"kube-state-metrics-84c885658c-pflhp\" (UID: \"1f78768e-a13c-4f1a-92ab-6d65b9f296fb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.358729 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.358714 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nfdn\" (UniqueName: \"kubernetes.io/projected/54f00258-b97d-41e8-8c39-4d489f18bc73-kube-api-access-6nfdn\") pod \"node-exporter-qqwb4\" (UID: \"54f00258-b97d-41e8-8c39-4d489f18bc73\") " pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.369565 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.369511 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:22.430947 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.430907 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" Sep 18 21:53:22.466983 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.466952 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:22.468768 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.468739 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" Sep 18 21:53:22.485701 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.485660 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qqwb4" Sep 18 21:53:22.501990 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:22.501931 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f00258_b97d_41e8_8c39_4d489f18bc73.slice/crio-31fef121d19c34a2974fac61eb54bcfb6061e2ba2a08c418f03b71720097ee0f WatchSource:0}: Error finding container 31fef121d19c34a2974fac61eb54bcfb6061e2ba2a08c418f03b71720097ee0f: Status 404 returned error can't find the container with id 31fef121d19c34a2974fac61eb54bcfb6061e2ba2a08c418f03b71720097ee0f Sep 18 21:53:22.638897 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.638804 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:22.709455 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.709431 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb"] Sep 18 21:53:22.711564 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:22.711540 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a249aae_5477_4870_94f7_9d3709f045e8.slice/crio-1c17316527fdb20903e9237c02c2d713dd35e2fa1ed0870348471eba604aedb7 WatchSource:0}: Error finding container 1c17316527fdb20903e9237c02c2d713dd35e2fa1ed0870348471eba604aedb7: Status 404 returned error can't find the container with id 1c17316527fdb20903e9237c02c2d713dd35e2fa1ed0870348471eba604aedb7 Sep 18 21:53:22.755704 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.755646 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-pflhp"] Sep 18 21:53:22.758538 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:22.758509 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f78768e_a13c_4f1a_92ab_6d65b9f296fb.slice/crio-3ab32d34c8db63bcdc9aa5ba9aea719d4d3f4dd15082e96a2ab6cbba3a2f3939 WatchSource:0}: Error finding container 3ab32d34c8db63bcdc9aa5ba9aea719d4d3f4dd15082e96a2ab6cbba3a2f3939: Status 404 returned error can't find the container with id 3ab32d34c8db63bcdc9aa5ba9aea719d4d3f4dd15082e96a2ab6cbba3a2f3939 Sep 18 21:53:22.886626 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.886587 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" event={"ID":"1f78768e-a13c-4f1a-92ab-6d65b9f296fb","Type":"ContainerStarted","Data":"3ab32d34c8db63bcdc9aa5ba9aea719d4d3f4dd15082e96a2ab6cbba3a2f3939"} Sep 18 21:53:22.888393 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.888362 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" event={"ID":"4a249aae-5477-4870-94f7-9d3709f045e8","Type":"ContainerStarted","Data":"5f7e923c93c81b8d1ea4418190bc806b55c890ae1db45f586a6a5e9c445ea27b"} Sep 18 21:53:22.888501 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.888414 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" event={"ID":"4a249aae-5477-4870-94f7-9d3709f045e8","Type":"ContainerStarted","Data":"ecc29381c37fc448420d569257f737a6a852875503da5e69907c9987cf9fbd58"} Sep 18 21:53:22.888501 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.888434 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" event={"ID":"4a249aae-5477-4870-94f7-9d3709f045e8","Type":"ContainerStarted","Data":"1c17316527fdb20903e9237c02c2d713dd35e2fa1ed0870348471eba604aedb7"} Sep 18 21:53:22.889511 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:22.889454 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqwb4" event={"ID":"54f00258-b97d-41e8-8c39-4d489f18bc73","Type":"ContainerStarted","Data":"31fef121d19c34a2974fac61eb54bcfb6061e2ba2a08c418f03b71720097ee0f"} Sep 18 21:53:23.196074 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:53:23.195984 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ndv9n" podUID="2de0f77b-b8af-4621-99bb-86b1167904c1" Sep 18 21:53:23.227656 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:23.227585 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:23.326524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:23.326339 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:23.744114 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:23.744009 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:23.896184 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:23.896142 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqwb4" event={"ID":"54f00258-b97d-41e8-8c39-4d489f18bc73","Type":"ContainerStarted","Data":"1f0308b5db5519e80540f129806b381044a5fc3c9368b2cb53ea01c7bdb985d4"} Sep 18 21:53:24.902204 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:24.902111 2553 generic.go:356] "Generic (PLEG): container finished" podID="54f00258-b97d-41e8-8c39-4d489f18bc73" containerID="1f0308b5db5519e80540f129806b381044a5fc3c9368b2cb53ea01c7bdb985d4" exitCode=0 Sep 18 21:53:24.902690 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:24.902197 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqwb4" event={"ID":"54f00258-b97d-41e8-8c39-4d489f18bc73","Type":"ContainerDied","Data":"1f0308b5db5519e80540f129806b381044a5fc3c9368b2cb53ea01c7bdb985d4"} Sep 18 21:53:24.904527 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:24.904500 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" event={"ID":"1f78768e-a13c-4f1a-92ab-6d65b9f296fb","Type":"ContainerStarted","Data":"239cc729448f08b83acaccd65f8e76a26807c22469bef9f8fae128839535652f"} Sep 18 21:53:24.904680 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:24.904556 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" event={"ID":"1f78768e-a13c-4f1a-92ab-6d65b9f296fb","Type":"ContainerStarted","Data":"06e376fa5377e0e8a648f53b9de8a4446d24b3d9b7e7c5da724a294d3103789d"} Sep 18 21:53:24.904680 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:24.904587 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" event={"ID":"1f78768e-a13c-4f1a-92ab-6d65b9f296fb","Type":"ContainerStarted","Data":"3b77ed6fce1175fd1dfbe1b5fe5f43b9a420b049f9b1f91145d6150427407010"} Sep 18 21:53:24.906494 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:24.906473 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" event={"ID":"4a249aae-5477-4870-94f7-9d3709f045e8","Type":"ContainerStarted","Data":"1f0ab918c3081fa9ce3a7cfd26bdd25321e0d50ee9af4cf8753f8facdc193452"} Sep 18 21:53:24.948855 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:24.948809 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-flfrb" podStartSLOduration=1.396922553 podStartE2EDuration="2.948792173s" totalImagesPullingTime="1.55186962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:24.947533105 +0000 UTC m=+161.924594650" watchObservedRunningTime="2026-09-18 21:53:24.948792173 +0000 UTC m=+161.925853696" Sep 18 21:53:24.976339 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:24.976267 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-pflhp" podStartSLOduration=1.3484242260000001 podStartE2EDuration="2.976244342s" totalImagesPullingTime="1.627820116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:24.974772772 +0000 UTC m=+161.951834328" watchObservedRunningTime="2026-09-18 21:53:24.976244342 +0000 UTC m=+161.953305867" Sep 18 21:53:25.127153 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.127112 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:25.230418 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.230320 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:25.242156 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.242126 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59f4649669-5h4n7"] Sep 18 21:53:25.263409 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.263371 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.266590 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.266564 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59f4649669-5h4n7"] Sep 18 21:53:25.267857 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.267835 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 21:53:25.267857 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.267847 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 21:53:25.268094 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.268080 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 21:53:25.268138 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.268120 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fnfm43tsop84t\"" Sep 18 21:53:25.268286 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.268271 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 21:53:25.268388 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.268374 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-44jld\"" Sep 18 21:53:25.268522 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.268505 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 21:53:25.270963 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.270936 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.271056 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.270995 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.271116 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.271097 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.271186 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.271170 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-tls\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.271247 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.271200 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc36e56b-80ec-44d7-8348-0771ca7e307d-metrics-client-ca\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.271247 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.271241 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7qjq\" (UniqueName: \"kubernetes.io/projected/fc36e56b-80ec-44d7-8348-0771ca7e307d-kube-api-access-c7qjq\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.271350 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.271272 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.271350 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.271310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-grpc-tls\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.372681 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.372628 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.372854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.372691 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.372854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.372724 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.372854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.372748 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-tls\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.372854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.372763 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc36e56b-80ec-44d7-8348-0771ca7e307d-metrics-client-ca\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.372854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.372795 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qjq\" (UniqueName: \"kubernetes.io/projected/fc36e56b-80ec-44d7-8348-0771ca7e307d-kube-api-access-c7qjq\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.372854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.372822 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.372854 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.372855 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-grpc-tls\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.373618 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.373589 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc36e56b-80ec-44d7-8348-0771ca7e307d-metrics-client-ca\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.375688 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.375623 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.375796 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.375724 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.376278 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.376254 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-tls\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.376388 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.376290 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.376456 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.376415 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.376762 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.376743 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc36e56b-80ec-44d7-8348-0771ca7e307d-secret-grpc-tls\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.382821 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.382803 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7qjq\" (UniqueName: \"kubernetes.io/projected/fc36e56b-80ec-44d7-8348-0771ca7e307d-kube-api-access-c7qjq\") pod \"thanos-querier-59f4649669-5h4n7\" (UID: \"fc36e56b-80ec-44d7-8348-0771ca7e307d\") " pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.574435 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.574351 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:25.617681 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.617630 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:25.760302 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.760271 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:25.898976 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:25.898941 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc36e56b_80ec_44d7_8348_0771ca7e307d.slice/crio-486a2748b98a185cd1363273fb1086a1c35b4eda60b892a090972ea5e53312b1 WatchSource:0}: Error finding container 486a2748b98a185cd1363273fb1086a1c35b4eda60b892a090972ea5e53312b1: Status 404 returned error can't find the container with id 486a2748b98a185cd1363273fb1086a1c35b4eda60b892a090972ea5e53312b1 Sep 18 21:53:25.902187 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.902162 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59f4649669-5h4n7"] Sep 18 21:53:25.912409 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.912383 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqwb4" event={"ID":"54f00258-b97d-41e8-8c39-4d489f18bc73","Type":"ContainerStarted","Data":"cf7251a694361b322844089f3e9e039faed5a5ce652c88c15b4bfbffc7dc0f6d"} Sep 18 21:53:25.912833 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.912432 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qqwb4" event={"ID":"54f00258-b97d-41e8-8c39-4d489f18bc73","Type":"ContainerStarted","Data":"7c02d435bb6555f3e7db11db45b79bfa9de83de20f10420361404b80cea7cc9b"} Sep 18 21:53:25.913704 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:25.913680 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" event={"ID":"fc36e56b-80ec-44d7-8348-0771ca7e307d","Type":"ContainerStarted","Data":"486a2748b98a185cd1363273fb1086a1c35b4eda60b892a090972ea5e53312b1"} Sep 18 21:53:26.381786 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:26.381754 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:53:26.384160 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:26.384136 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7249b8d1-5008-48e4-94ea-079001c7a03e-metrics-tls\") pod \"dns-default-shllc\" (UID: \"7249b8d1-5008-48e4-94ea-079001c7a03e\") " pod="openshift-dns/dns-default-shllc" Sep 18 21:53:26.686195 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:26.686112 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-np4sp\"" Sep 18 21:53:26.694361 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:26.694333 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-shllc" Sep 18 21:53:26.817627 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:26.816875 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:27.001361 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:27.001256 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qqwb4" podStartSLOduration=3.963424404 podStartE2EDuration="5.001240506s" totalImagesPullingTime="957.26375ms" totalInitContainerRuntime="80.552352ms" isStatefulPod=true podCreationTimestamp="2026-09-18 21:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:25.941997877 +0000 UTC m=+162.919059444" watchObservedRunningTime="2026-09-18 21:53:27.001240506 +0000 UTC m=+163.978302019" Sep 18 21:53:27.001742 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:27.001517 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-shllc"] Sep 18 21:53:27.003763 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:27.003727 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7249b8d1_5008_48e4_94ea_079001c7a03e.slice/crio-3f4bc2ff532493dfed6e8df47d1856af4b7cc9140f65a0ae93bb643588ad3e4d WatchSource:0}: Error finding container 3f4bc2ff532493dfed6e8df47d1856af4b7cc9140f65a0ae93bb643588ad3e4d: Status 404 returned error can't find the container with id 3f4bc2ff532493dfed6e8df47d1856af4b7cc9140f65a0ae93bb643588ad3e4d Sep 18 21:53:27.162062 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:27.162032 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:27.924297 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:27.924259 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" event={"ID":"fc36e56b-80ec-44d7-8348-0771ca7e307d","Type":"ContainerStarted","Data":"c5b21e748d8991bc070cf9a042e74249ce8924ab95d6ab9861c98bb820168334"} Sep 18 21:53:27.924460 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:27.924390 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" event={"ID":"fc36e56b-80ec-44d7-8348-0771ca7e307d","Type":"ContainerStarted","Data":"ff52579704e1760983ffa3a836dc830d581155fdce840f29e5f1a90139bb0b50"} Sep 18 21:53:27.924460 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:27.924433 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" event={"ID":"fc36e56b-80ec-44d7-8348-0771ca7e307d","Type":"ContainerStarted","Data":"32bfc768b1d5695254f1aa778f6b2853249b954d026a1cfd9b56868884fe2cdf"} Sep 18 21:53:27.926190 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:27.926160 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shllc" event={"ID":"7249b8d1-5008-48e4-94ea-079001c7a03e","Type":"ContainerStarted","Data":"3f4bc2ff532493dfed6e8df47d1856af4b7cc9140f65a0ae93bb643588ad3e4d"} Sep 18 21:53:28.465793 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.465716 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:28.466377 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.466048 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:53:28.470175 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.470152 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.477484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.476626 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-amlc03rhg23g\"" Sep 18 21:53:28.477484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.476640 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 21:53:28.477484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.476904 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 21:53:28.477484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.477054 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 21:53:28.477484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.477275 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 21:53:28.477484 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.477320 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 21:53:28.478134 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.477510 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 21:53:28.478134 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.477573 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 21:53:28.478134 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.477640 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 21:53:28.478134 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.477726 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 21:53:28.480639 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.480617 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gphjk\"" Sep 18 21:53:28.480842 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.480824 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 21:53:28.480920 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.480829 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 21:53:28.480979 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.480914 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 21:53:28.481595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.481420 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 21:53:28.481595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.481467 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 21:53:28.481595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.481476 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 21:53:28.491203 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.491174 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.504913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.504963 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.504993 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505066 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505112 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505138 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505167 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505197 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbqhg\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-kube-api-access-xbqhg\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505229 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-config-out\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505250 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505272 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505296 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-config\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505317 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505350 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505372 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-web-config\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.505752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505393 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.506566 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505443 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.506566 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505468 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.506566 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505495 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.506566 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.505517 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606422 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606383 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606619 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606434 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606619 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606461 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606619 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:53:28.606588 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle podName:6db59b2c-4093-42b9-af51-17f8c6300114 nodeName:}" failed. No retries permitted until 2026-09-18 21:53:29.106567751 +0000 UTC m=+166.083629254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114") : configmap references non-existent config key: ca-bundle.crt Sep 18 21:53:28.606619 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606608 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606642 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606684 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606719 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606767 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606796 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606830 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbqhg\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-kube-api-access-xbqhg\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606895 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-config-out\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606888 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.606926 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606919 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607398 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606942 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607398 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606969 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-config\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607398 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.606992 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607398 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.607035 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607398 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.607063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-web-config\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607398 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.607086 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607398 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.607151 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607772 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.607435 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.607772 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.607732 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.608095 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.608056 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.608775 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.608358 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.608775 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.608729 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.611766 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.610385 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.611766 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.610806 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.611766 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.610982 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-config-out\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.611766 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.611405 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.611766 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.611474 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-web-config\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.612077 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.611841 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.612888 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.612864 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.612991 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.612904 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.613237 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.613195 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.613342 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.613272 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.613997 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.613976 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-config\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.614811 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.614783 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:28.627900 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:28.627873 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbqhg\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-kube-api-access-xbqhg\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:29.113605 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.113569 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:29.114298 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.114273 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:29.384449 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.384360 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:29.547760 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.547729 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:29.653740 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.653649 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:29.677633 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.677590 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:53:29.681487 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:53:29.681461 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db59b2c_4093_42b9_af51_17f8c6300114.slice/crio-4f068585305fbee4f02712794679168cb886e101bda982091760c3fd1903195f WatchSource:0}: Error finding container 4f068585305fbee4f02712794679168cb886e101bda982091760c3fd1903195f: Status 404 returned error can't find the container with id 4f068585305fbee4f02712794679168cb886e101bda982091760c3fd1903195f Sep 18 21:53:29.937556 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.937464 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" event={"ID":"fc36e56b-80ec-44d7-8348-0771ca7e307d","Type":"ContainerStarted","Data":"17e4496eef647fc9ad0ce3d44291400ab563b9c4a2b4059045a5099aef329ef4"} Sep 18 21:53:29.937556 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.937544 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" event={"ID":"fc36e56b-80ec-44d7-8348-0771ca7e307d","Type":"ContainerStarted","Data":"4e79442ce24d992c38b1cc10ceeef42ca4e103636b53ff0897ed95f1ebe853c0"} Sep 18 21:53:29.937879 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.937685 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:29.937879 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.937747 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" event={"ID":"fc36e56b-80ec-44d7-8348-0771ca7e307d","Type":"ContainerStarted","Data":"e4017a604e258420988cf630bb7537a95b9f483467ec47d717799b2462c0ccb7"} Sep 18 21:53:29.938709 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.938690 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerStarted","Data":"4f068585305fbee4f02712794679168cb886e101bda982091760c3fd1903195f"} Sep 18 21:53:29.940316 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.940296 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shllc" event={"ID":"7249b8d1-5008-48e4-94ea-079001c7a03e","Type":"ContainerStarted","Data":"a99172fae27e9a5f8b1a0ef296876d294611814f1a596e34fe6c71724710e889"} Sep 18 21:53:29.940427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.940334 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-shllc" event={"ID":"7249b8d1-5008-48e4-94ea-079001c7a03e","Type":"ContainerStarted","Data":"cfe91bc6967ecbdd2e7e83dedc62a89dc7f6086e723a9df84db2259bc1b4aa65"} Sep 18 21:53:29.940427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.940370 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-shllc" Sep 18 21:53:29.969540 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.969477 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" podStartSLOduration=1.946623464 podStartE2EDuration="4.969461011s" totalImagesPullingTime="3.022837547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:29.966995746 +0000 UTC m=+166.944057291" watchObservedRunningTime="2026-09-18 21:53:29.969461011 +0000 UTC m=+166.946522534" Sep 18 21:53:29.992029 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:29.991972 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-shllc" podStartSLOduration=129.861216127 podStartE2EDuration="2m11.991955411s" totalImagesPullingTime="2.130739284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:29.989885796 +0000 UTC m=+166.966947341" watchObservedRunningTime="2026-09-18 21:53:29.991955411 +0000 UTC m=+166.969016934" Sep 18 21:53:30.946830 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:30.946793 2553 generic.go:356] "Generic (PLEG): container finished" podID="6db59b2c-4093-42b9-af51-17f8c6300114" containerID="ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5" exitCode=0 Sep 18 21:53:30.947251 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:30.946882 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerDied","Data":"ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5"} Sep 18 21:53:33.964654 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:33.964525 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerStarted","Data":"301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab"} Sep 18 21:53:34.971560 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:34.971524 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerStarted","Data":"c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f"} Sep 18 21:53:34.972054 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:34.971588 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerStarted","Data":"c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4"} Sep 18 21:53:34.972054 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:34.971613 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerStarted","Data":"83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800"} Sep 18 21:53:34.972054 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:34.971636 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerStarted","Data":"53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82"} Sep 18 21:53:34.972054 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:34.971658 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerStarted","Data":"088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f"} Sep 18 21:53:35.952530 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:35.952503 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59f4649669-5h4n7" Sep 18 21:53:35.990213 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:35.990164 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.129618864 podStartE2EDuration="7.990147175s" totalImagesPullingTime="3.842739398s" totalInitContainerRuntime="17.788913ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:53:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:53:35.023122749 +0000 UTC m=+172.000184338" watchObservedRunningTime="2026-09-18 21:53:35.990147175 +0000 UTC m=+172.967208699" Sep 18 21:53:36.173967 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:36.173937 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:36.260611 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:36.260526 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:38.175999 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:38.175955 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:53:39.384933 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:39.384900 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:53:39.949760 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:39.949725 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-shllc" Sep 18 21:53:43.437801 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:43.437766 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:43.553747 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:43.553714 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:43.724717 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:43.724621 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:43.824918 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:43.824883 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:45.228909 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:45.228856 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:45.329767 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:45.329736 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:45.607845 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:45.607812 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:45.692481 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:45.692440 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:45.783615 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:45.783580 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:45.916994 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:45.916905 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:46.281092 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:46.281002 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:46.353990 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:46.353959 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:46.675695 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:46.675645 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:46.754524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:46.754486 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:47.094091 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:47.094006 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:47.186547 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:47.186510 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:47.508742 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:47.508709 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:47.648903 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:47.648866 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:48.513519 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:48.513490 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:48.685796 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:48.685737 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:49.113689 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:49.113642 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:49.221174 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:49.221132 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:52.748518 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:52.748476 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:52.845899 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:52.845865 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:52.949467 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:52.949436 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:56.622619 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:56.622586 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:56.729549 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:56.729513 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:56.791817 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:56.791784 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:57.886902 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:57.886871 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:58.041445 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:58.041412 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:59.556702 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:59.556646 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:53:59.665857 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:53:59.665824 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:00.328717 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:00.328659 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:01.914168 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:01.914134 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:02.025961 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:02.025927 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:06.097351 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:06.097321 2553 generic.go:356] "Generic (PLEG): container finished" podID="70626e54-50fd-4bc1-9035-3301ba72ef3a" containerID="d4a711125faa729af2f08d4675bd9a85507a043dbbe8e2bb59b266a0761c692a" exitCode=0 Sep 18 21:54:06.097792 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:06.097399 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" event={"ID":"70626e54-50fd-4bc1-9035-3301ba72ef3a","Type":"ContainerDied","Data":"d4a711125faa729af2f08d4675bd9a85507a043dbbe8e2bb59b266a0761c692a"} Sep 18 21:54:06.097792 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:06.097752 2553 scope.go:117] "RemoveContainer" containerID="d4a711125faa729af2f08d4675bd9a85507a043dbbe8e2bb59b266a0761c692a" Sep 18 21:54:06.726848 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:06.726811 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:06.825576 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:06.825543 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:07.103217 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:07.103184 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-s2tqn" event={"ID":"70626e54-50fd-4bc1-9035-3301ba72ef3a","Type":"ContainerStarted","Data":"e7ef0fae57a51cc16ddfae336fbc721ef230be1b199485b56fd8c33cf21d3ecb"} Sep 18 21:54:14.427704 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:14.427647 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:14.523620 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:14.523587 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:14.604445 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:14.604409 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:16.140833 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:16.140799 2553 generic.go:356] "Generic (PLEG): container finished" podID="84bca18d-4a50-4150-b87f-bed5cc8f7d6c" containerID="a56e90407f0628380ac4d3d9ad857e4ffa227a0e5c6ca01e8f77961d82b2c1dc" exitCode=0 Sep 18 21:54:16.141272 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:16.140872 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" event={"ID":"84bca18d-4a50-4150-b87f-bed5cc8f7d6c","Type":"ContainerDied","Data":"a56e90407f0628380ac4d3d9ad857e4ffa227a0e5c6ca01e8f77961d82b2c1dc"} Sep 18 21:54:16.141272 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:16.141188 2553 scope.go:117] "RemoveContainer" containerID="a56e90407f0628380ac4d3d9ad857e4ffa227a0e5c6ca01e8f77961d82b2c1dc" Sep 18 21:54:17.147465 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:17.147436 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-28h8h" event={"ID":"84bca18d-4a50-4150-b87f-bed5cc8f7d6c","Type":"ContainerStarted","Data":"800f37a6a854c5288b4b0a430ab249bf64a7c6b19c2f1b6b7037b97aeebb405a"} Sep 18 21:54:28.191412 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:28.191379 2553 generic.go:356] "Generic (PLEG): container finished" podID="3e0597be-3aa5-45c1-84a3-4049e18fee3a" containerID="1e19570581664bfaa7c35f50c2934691168403a738232baafc33feec6b25284d" exitCode=0 Sep 18 21:54:28.191867 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:28.191425 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" event={"ID":"3e0597be-3aa5-45c1-84a3-4049e18fee3a","Type":"ContainerDied","Data":"1e19570581664bfaa7c35f50c2934691168403a738232baafc33feec6b25284d"} Sep 18 21:54:28.191867 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:28.191751 2553 scope.go:117] "RemoveContainer" containerID="1e19570581664bfaa7c35f50c2934691168403a738232baafc33feec6b25284d" Sep 18 21:54:29.199559 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:29.199513 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-b97hx" event={"ID":"3e0597be-3aa5-45c1-84a3-4049e18fee3a","Type":"ContainerStarted","Data":"a1db9350764521fb0e6a870395e711084bf4bd6e60ec28f82f65566d06a1bece"} Sep 18 21:54:29.384574 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:29.384539 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:29.402325 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:29.402286 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:29.547098 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:29.547020 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:29.649976 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:29.649935 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:30.220590 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:30.220561 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:41.421508 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:41.421473 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:42.059521 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:42.059482 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:46.819746 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:46.819704 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:54:46.820806 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:46.820770 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="prometheus" containerID="cri-o://301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab" gracePeriod=600 Sep 18 21:54:46.821316 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:46.821263 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy" containerID="cri-o://c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4" gracePeriod=600 Sep 18 21:54:46.822708 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:46.821352 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy-web" containerID="cri-o://83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800" gracePeriod=600 Sep 18 21:54:46.823109 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:46.821380 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="thanos-sidecar" containerID="cri-o://53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82" gracePeriod=600 Sep 18 21:54:46.823285 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:46.821403 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="config-reloader" containerID="cri-o://088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f" gracePeriod=600 Sep 18 21:54:46.823458 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:46.821734 2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f" gracePeriod=600 Sep 18 21:54:47.272659 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272626 2553 generic.go:356] "Generic (PLEG): container finished" podID="6db59b2c-4093-42b9-af51-17f8c6300114" containerID="c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f" exitCode=0 Sep 18 21:54:47.272659 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272653 2553 generic.go:356] "Generic (PLEG): container finished" podID="6db59b2c-4093-42b9-af51-17f8c6300114" containerID="c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4" exitCode=0 Sep 18 21:54:47.272659 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272674 2553 generic.go:356] "Generic (PLEG): container finished" podID="6db59b2c-4093-42b9-af51-17f8c6300114" containerID="53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82" exitCode=0 Sep 18 21:54:47.272659 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272681 2553 generic.go:356] "Generic (PLEG): container finished" podID="6db59b2c-4093-42b9-af51-17f8c6300114" containerID="088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f" exitCode=0 Sep 18 21:54:47.272659 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272686 2553 generic.go:356] "Generic (PLEG): container finished" podID="6db59b2c-4093-42b9-af51-17f8c6300114" containerID="301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab" exitCode=0 Sep 18 21:54:47.272965 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272701 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerDied","Data":"c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f"} Sep 18 21:54:47.272965 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272763 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerDied","Data":"c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4"} Sep 18 21:54:47.272965 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272791 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerDied","Data":"53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82"} Sep 18 21:54:47.272965 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272814 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerDied","Data":"088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f"} Sep 18 21:54:47.272965 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:47.272837 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerDied","Data":"301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab"} Sep 18 21:54:48.071476 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.071453 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.219595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219493 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219550 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219569 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbqhg\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-kube-api-access-xbqhg\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219584 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-config\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219595 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219600 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-0\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219617 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-thanos-prometheus-http-client-file\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219723 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-kubelet-serving-ca-bundle\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219757 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-grpc-tls\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219782 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-db\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219810 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-kube-rbac-proxy\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219836 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-metrics-client-ca\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219861 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-2\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219895 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-web-config\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219923 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-1\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.219996 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.219981 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-serving-certs-ca-bundle\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.220488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220010 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-config-out\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.220488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220068 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.220488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220100 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-metrics-client-certs\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.220488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220118 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:48.220488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220147 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-tls-assets\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.220488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220189 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-tls\") pod \"6db59b2c-4093-42b9-af51-17f8c6300114\" (UID: \"6db59b2c-4093-42b9-af51-17f8c6300114\") " Sep 18 21:54:48.220488 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220482 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.220839 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220477 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:48.220839 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220810 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:48.220933 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.220878 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:48.221118 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.221090 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:54:48.221223 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.221152 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:48.222442 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.222394 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:48.222442 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.222404 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 21:54:48.223441 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.223311 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.223441 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.223412 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-config" (OuterVolumeSpecName: "config") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.223793 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.223767 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.224010 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.223989 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-config-out" (OuterVolumeSpecName: "config-out") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 21:54:48.224420 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.224397 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.224420 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.224413 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.224558 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.224527 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-kube-api-access-xbqhg" (OuterVolumeSpecName: "kube-api-access-xbqhg") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "kube-api-access-xbqhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:54:48.224824 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.224801 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.225427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.225404 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.225486 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.225411 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 21:54:48.226012 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.225997 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.235461 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.235440 2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-web-config" (OuterVolumeSpecName: "web-config") pod "6db59b2c-4093-42b9-af51-17f8c6300114" (UID: "6db59b2c-4093-42b9-af51-17f8c6300114"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 21:54:48.280201 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.280167 2553 generic.go:356] "Generic (PLEG): container finished" podID="6db59b2c-4093-42b9-af51-17f8c6300114" containerID="83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800" exitCode=0 Sep 18 21:54:48.280362 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.280251 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.280362 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.280241 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerDied","Data":"83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800"} Sep 18 21:54:48.280435 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.280397 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6db59b2c-4093-42b9-af51-17f8c6300114","Type":"ContainerDied","Data":"4f068585305fbee4f02712794679168cb886e101bda982091760c3fd1903195f"} Sep 18 21:54:48.280435 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.280430 2553 scope.go:117] "RemoveContainer" containerID="c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f" Sep 18 21:54:48.288511 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.288488 2553 scope.go:117] "RemoveContainer" containerID="c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4" Sep 18 21:54:48.295639 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.295622 2553 scope.go:117] "RemoveContainer" containerID="83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800" Sep 18 21:54:48.302161 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.302146 2553 scope.go:117] "RemoveContainer" containerID="53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82" Sep 18 21:54:48.307349 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.307328 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:54:48.309404 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.309390 2553 scope.go:117] "RemoveContainer" containerID="088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f" Sep 18 21:54:48.313047 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.313023 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:54:48.316794 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.316776 2553 scope.go:117] "RemoveContainer" containerID="301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab" Sep 18 21:54:48.321089 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321069 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321089 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321089 2553 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-metrics-client-certs\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321100 2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-tls-assets\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321110 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321118 2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321127 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbqhg\" (UniqueName: \"kubernetes.io/projected/6db59b2c-4093-42b9-af51-17f8c6300114-kube-api-access-xbqhg\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321135 2553 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-config\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321143 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321153 2553 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321162 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321170 2553 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-grpc-tls\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321178 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-db\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321185 2553 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-secret-kube-rbac-proxy\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321193 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-metrics-client-ca\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321201 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321209 2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6db59b2c-4093-42b9-af51-17f8c6300114-web-config\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321218 2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321225 2553 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6db59b2c-4093-42b9-af51-17f8c6300114-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.321246 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.321233 2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6db59b2c-4093-42b9-af51-17f8c6300114-config-out\") on node \"ip-10-0-143-133.ec2.internal\" DevicePath \"\"" Sep 18 21:54:48.324080 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.324066 2553 scope.go:117] "RemoveContainer" containerID="ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5" Sep 18 21:54:48.330455 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.330439 2553 scope.go:117] "RemoveContainer" containerID="c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f" Sep 18 21:54:48.330732 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:54:48.330712 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f\": container with ID starting with c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f not found: ID does not exist" containerID="c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f" Sep 18 21:54:48.330807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.330737 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f"} err="failed to get container status \"c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f\": rpc error: code = NotFound desc = could not find container \"c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f\": container with ID starting with c19e053a4dc3d0fe0bcbc9ed05876e8d95c83522b753cee440ef0229ef95e97f not found: ID does not exist" Sep 18 21:54:48.330807 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.330768 2553 scope.go:117] "RemoveContainer" containerID="c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4" Sep 18 21:54:48.330982 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:54:48.330967 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4\": container with ID starting with c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4 not found: ID does not exist" containerID="c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4" Sep 18 21:54:48.331024 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.330987 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4"} err="failed to get container status \"c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4\": rpc error: code = NotFound desc = could not find container \"c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4\": container with ID starting with c2f8ad56ba40d52e18c8e896ef0cdfb9f0839e654af534768ecbc3c3d8e926f4 not found: ID does not exist" Sep 18 21:54:48.331024 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.331001 2553 scope.go:117] "RemoveContainer" containerID="83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800" Sep 18 21:54:48.331255 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:54:48.331238 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800\": container with ID starting with 83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800 not found: ID does not exist" containerID="83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800" Sep 18 21:54:48.331293 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.331263 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800"} err="failed to get container status \"83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800\": rpc error: code = NotFound desc = could not find container \"83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800\": container with ID starting with 83fc1c80f97eda880c7538fbff8b525f78f351ca79554ed44947eb34bb53b800 not found: ID does not exist" Sep 18 21:54:48.331293 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.331279 2553 scope.go:117] "RemoveContainer" containerID="53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82" Sep 18 21:54:48.331474 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:54:48.331460 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82\": container with ID starting with 53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82 not found: ID does not exist" containerID="53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82" Sep 18 21:54:48.331517 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.331477 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82"} err="failed to get container status \"53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82\": rpc error: code = NotFound desc = could not find container \"53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82\": container with ID starting with 53463d48ece4946f8c844a3a697b27bccb06d78a2d4c67cd013573b1cb622c82 not found: ID does not exist" Sep 18 21:54:48.331517 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.331491 2553 scope.go:117] "RemoveContainer" containerID="088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f" Sep 18 21:54:48.331779 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:54:48.331753 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f\": container with ID starting with 088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f not found: ID does not exist" containerID="088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f" Sep 18 21:54:48.331838 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.331779 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f"} err="failed to get container status \"088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f\": rpc error: code = NotFound desc = could not find container \"088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f\": container with ID starting with 088c9abb69f4c895f1c9b2dc067e0d021fcc2a019b58e66d0931192c530eb85f not found: ID does not exist" Sep 18 21:54:48.331838 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.331792 2553 scope.go:117] "RemoveContainer" containerID="301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab" Sep 18 21:54:48.332041 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:54:48.332025 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab\": container with ID starting with 301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab not found: ID does not exist" containerID="301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab" Sep 18 21:54:48.332081 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.332046 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab"} err="failed to get container status \"301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab\": rpc error: code = NotFound desc = could not find container \"301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab\": container with ID starting with 301f45fce634693f18354addd84cf746d00d57a57c96433c4c6247eb3d4650ab not found: ID does not exist" Sep 18 21:54:48.332081 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.332063 2553 scope.go:117] "RemoveContainer" containerID="ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5" Sep 18 21:54:48.332323 ip-10-0-143-133 kubenswrapper[2553]: E0918 21:54:48.332276 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5\": container with ID starting with ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5 not found: ID does not exist" containerID="ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5" Sep 18 21:54:48.332323 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.332293 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5"} err="failed to get container status \"ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5\": rpc error: code = NotFound desc = could not find container \"ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5\": container with ID starting with ab37700b564b3cb6d5071df483a35894a534dc4e9917ecc6ee70dcb92cc156c5 not found: ID does not exist" Sep 18 21:54:48.344206 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344186 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:54:48.344477 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344466 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="init-config-reloader" Sep 18 21:54:48.344524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344479 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="init-config-reloader" Sep 18 21:54:48.344524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344487 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="config-reloader" Sep 18 21:54:48.344524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344492 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="config-reloader" Sep 18 21:54:48.344524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344499 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy-web" Sep 18 21:54:48.344524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344504 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy-web" Sep 18 21:54:48.344524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344517 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="prometheus" Sep 18 21:54:48.344524 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344521 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="prometheus" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344532 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy-thanos" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344537 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy-thanos" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344544 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="thanos-sidecar" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344549 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="thanos-sidecar" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344561 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344566 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344632 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="prometheus" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344640 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy-thanos" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344646 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="thanos-sidecar" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344652 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy-web" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344657 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="kube-rbac-proxy" Sep 18 21:54:48.344735 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.344678 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" containerName="config-reloader" Sep 18 21:54:48.351456 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.351437 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.354043 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354025 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 21:54:48.354123 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354073 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 21:54:48.354173 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354129 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 21:54:48.354332 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354312 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 21:54:48.354447 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354428 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 21:54:48.354504 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354451 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 21:54:48.354549 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354452 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 21:54:48.354630 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354611 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 21:54:48.354751 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354695 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 21:54:48.354835 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354811 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 21:54:48.354960 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354945 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 21:54:48.355035 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.354954 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 21:54:48.355079 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.355056 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-amlc03rhg23g\"" Sep 18 21:54:48.355240 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.355212 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gphjk\"" Sep 18 21:54:48.357796 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.357776 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 21:54:48.358739 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.358721 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 21:54:48.362728 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.362709 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 21:54:48.371324 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.371303 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:54:48.522481 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522396 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-config\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522481 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522439 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522481 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522466 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522699 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522521 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522699 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522568 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522699 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522586 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522699 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522603 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522699 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522644 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522699 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522692 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522716 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522738 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxl5\" (UniqueName: \"kubernetes.io/projected/44b58801-29e6-42d0-a29d-0a5e8e7e355e-kube-api-access-hqxl5\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522768 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522797 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522814 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522836 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.522884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522855 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44b58801-29e6-42d0-a29d-0a5e8e7e355e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.523084 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522913 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.523084 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522934 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44b58801-29e6-42d0-a29d-0a5e8e7e355e-config-out\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.523084 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522983 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.523084 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.522999 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-web-config\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623382 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623382 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623387 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44b58801-29e6-42d0-a29d-0a5e8e7e355e-config-out\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623624 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623414 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623624 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-web-config\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623624 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623475 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-config\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623624 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623499 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623624 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623520 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623624 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623547 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623624 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623575 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.623624 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623599 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623624 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623654 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623715 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623739 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623776 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxl5\" (UniqueName: \"kubernetes.io/projected/44b58801-29e6-42d0-a29d-0a5e8e7e355e-kube-api-access-hqxl5\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623806 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623841 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623909 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624026 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.623941 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44b58801-29e6-42d0-a29d-0a5e8e7e355e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624566 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.624176 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.624855 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.624826 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.625431 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.625406 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.626556 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.626428 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44b58801-29e6-42d0-a29d-0a5e8e7e355e-config-out\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.626556 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.626464 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44b58801-29e6-42d0-a29d-0a5e8e7e355e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.626556 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.626528 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.626556 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.626615 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-config\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.626556 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.626740 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.627109 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.626909 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.627570 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.627441 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.627570 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.627477 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.627988 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.627893 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-web-config\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.628075 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.628058 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.628141 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.628098 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.628304 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.628283 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.628873 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.628854 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.629161 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.629142 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.629427 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.629411 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44b58801-29e6-42d0-a29d-0a5e8e7e355e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.629987 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.629969 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44b58801-29e6-42d0-a29d-0a5e8e7e355e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.639346 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.639328 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxl5\" (UniqueName: \"kubernetes.io/projected/44b58801-29e6-42d0-a29d-0a5e8e7e355e-kube-api-access-hqxl5\") pod \"prometheus-k8s-0\" (UID: \"44b58801-29e6-42d0-a29d-0a5e8e7e355e\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.661282 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.661256 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:48.950832 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:48.950805 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 21:54:48.951412 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:54:48.951380 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b58801_29e6_42d0_a29d_0a5e8e7e355e.slice/crio-3968ecbccb0bf6254047b9167962659d49cde8d858d97caf0829789ca169a896 WatchSource:0}: Error finding container 3968ecbccb0bf6254047b9167962659d49cde8d858d97caf0829789ca169a896: Status 404 returned error can't find the container with id 3968ecbccb0bf6254047b9167962659d49cde8d858d97caf0829789ca169a896 Sep 18 21:54:49.186047 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:49.186013 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6db59b2c-4093-42b9-af51-17f8c6300114" path="/var/lib/kubelet/pods/6db59b2c-4093-42b9-af51-17f8c6300114/volumes" Sep 18 21:54:49.287381 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:49.287299 2553 generic.go:356] "Generic (PLEG): container finished" podID="44b58801-29e6-42d0-a29d-0a5e8e7e355e" containerID="cf42e42c1b71339d0559cacf4fe1f7a56432a3c34801543c4643e2e73535b428" exitCode=0 Sep 18 21:54:49.287381 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:49.287336 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44b58801-29e6-42d0-a29d-0a5e8e7e355e","Type":"ContainerDied","Data":"cf42e42c1b71339d0559cacf4fe1f7a56432a3c34801543c4643e2e73535b428"} Sep 18 21:54:49.287605 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:49.287386 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44b58801-29e6-42d0-a29d-0a5e8e7e355e","Type":"ContainerStarted","Data":"3968ecbccb0bf6254047b9167962659d49cde8d858d97caf0829789ca169a896"} Sep 18 21:54:50.295455 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:50.295377 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44b58801-29e6-42d0-a29d-0a5e8e7e355e","Type":"ContainerStarted","Data":"1dcbf88a15c5b94dccf49c09716553a068744c33c2457cc2e36cac7ac6c449cf"} Sep 18 21:54:50.295455 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:50.295442 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44b58801-29e6-42d0-a29d-0a5e8e7e355e","Type":"ContainerStarted","Data":"725b627e52d60197427ba8841217583fa030e6bb68699427ab6f27b389d068d0"} Sep 18 21:54:50.295871 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:50.295472 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44b58801-29e6-42d0-a29d-0a5e8e7e355e","Type":"ContainerStarted","Data":"c94e6838f9835de26b4d5e3c7ce0c59665504cb563cf5a806af97ac0e122dd4c"} Sep 18 21:54:50.295871 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:50.295498 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44b58801-29e6-42d0-a29d-0a5e8e7e355e","Type":"ContainerStarted","Data":"59f7e4cee96e87aa1a8c9da1413fbae2f40e80da73e35668a50f2aeb376c0345"} Sep 18 21:54:50.295871 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:50.295521 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44b58801-29e6-42d0-a29d-0a5e8e7e355e","Type":"ContainerStarted","Data":"2938ae0629f7a7303f49e029f7e5dececdbc9801a8cb86bacad10872986020d2"} Sep 18 21:54:50.295871 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:50.295549 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44b58801-29e6-42d0-a29d-0a5e8e7e355e","Type":"ContainerStarted","Data":"9bbef899349751585db67d8c643b350d039a0cb05724a3cfd26f0214d2696370"} Sep 18 21:54:50.744386 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:50.744355 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:53.661867 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:53.661816 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:54:55.017649 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:55.017612 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:55.123387 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:55.123350 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:55.987860 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:55.987823 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:54:55.990093 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:55.990070 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2de0f77b-b8af-4621-99bb-86b1167904c1-metrics-certs\") pod \"network-metrics-daemon-ndv9n\" (UID: \"2de0f77b-b8af-4621-99bb-86b1167904c1\") " pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:54:56.178983 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:56.178953 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5rt7r\"" Sep 18 21:54:56.187152 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:56.187130 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndv9n" Sep 18 21:54:56.459725 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:56.459650 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.441858749 podStartE2EDuration="8.459629733s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.770984ms" isStatefulPod=false podCreationTimestamp="2026-09-18 21:54:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:54:50.341590265 +0000 UTC m=+247.318651814" watchObservedRunningTime="2026-09-18 21:54:56.459629733 +0000 UTC m=+253.436691251" Sep 18 21:54:56.460197 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:56.460180 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ndv9n"] Sep 18 21:54:56.463354 ip-10-0-143-133 kubenswrapper[2553]: W0918 21:54:56.463324 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de0f77b_b8af_4621_99bb_86b1167904c1.slice/crio-5b81e16a45cd11455aa593e657ff19f48485fe52211e040234b212fea76f8ea0 WatchSource:0}: Error finding container 5b81e16a45cd11455aa593e657ff19f48485fe52211e040234b212fea76f8ea0: Status 404 returned error can't find the container with id 5b81e16a45cd11455aa593e657ff19f48485fe52211e040234b212fea76f8ea0 Sep 18 21:54:57.327038 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:57.326947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndv9n" event={"ID":"2de0f77b-b8af-4621-99bb-86b1167904c1","Type":"ContainerStarted","Data":"5b81e16a45cd11455aa593e657ff19f48485fe52211e040234b212fea76f8ea0"} Sep 18 21:54:58.333285 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:58.333241 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndv9n" event={"ID":"2de0f77b-b8af-4621-99bb-86b1167904c1","Type":"ContainerStarted","Data":"d9d8ef35b69341219d684881192219b53898d7ff5597ba231525c0fc1d9c1a59"} Sep 18 21:54:58.333736 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:58.333309 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndv9n" event={"ID":"2de0f77b-b8af-4621-99bb-86b1167904c1","Type":"ContainerStarted","Data":"89390de24df861e6eb848c08709171030bb7d6905edfe918b53e35e4ce22983b"} Sep 18 21:54:58.360833 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:58.360772 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ndv9n" podStartSLOduration=252.384533844 podStartE2EDuration="4m13.360750634s" totalImagesPullingTime="976.21679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 21:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 21:54:58.359234464 +0000 UTC m=+255.336295987" watchObservedRunningTime="2026-09-18 21:54:58.360750634 +0000 UTC m=+255.337812159" Sep 18 21:54:58.468264 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:58.468231 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:54:58.534156 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:54:58.534129 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:01.728737 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:01.728693 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:01.831553 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:01.831518 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:01.900519 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:01.900485 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:02.684299 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:02.684256 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:02.750176 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:02.750135 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:36.098142 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:36.098091 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:45.104117 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:45.104088 2553 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 21:55:46.992401 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:46.992345 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:47.094767 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:47.094733 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:48.661884 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:48.661849 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:55:48.677362 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:48.677338 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:55:49.559493 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:49.559458 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 21:55:56.741337 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:56.741303 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:55:56.820086 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:55:56.820051 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:00.653001 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:00.652963 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:06.404111 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:06.404074 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:06.509195 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:06.509160 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:08.737083 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:08.737046 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:08.818758 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:08.818724 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:14.631917 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:14.631882 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:14.736432 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:14.736396 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:14.843817 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:14.843776 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:17.078340 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:17.078297 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:17.186280 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:17.186228 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:55.658728 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:55.658689 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:55.745686 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:55.745640 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:56:55.848688 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:56:55.848632 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:09.103418 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:09.103382 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:09.183197 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:09.183159 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:22.812034 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:22.812001 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:22.974732 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:22.974701 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:29.800500 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:29.800468 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:30.070257 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:30.070174 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:30.212800 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:30.212767 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:30.305072 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:30.305036 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:30.991584 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:30.991551 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:31.115322 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:31.115288 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:31.381736 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:31.381690 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:31.472459 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:31.472418 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:31.589402 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:31.589364 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:31.997316 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:31.997287 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:32.183167 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:32.183129 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:32.342299 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:32.342212 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:57:32.450435 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:57:32.450401 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:58:07.598765 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:58:07.598677 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:58:08.754343 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:58:08.754302 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:58:22.530834 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:58:22.530796 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:58:22.671144 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:58:22.671103 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:58:42.513491 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:58:42.513458 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:58:53.542023 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:58:53.541987 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:00.562806 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:00.562770 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:00.699262 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:00.699234 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:00.818562 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:00.818477 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:00.949414 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:00.949384 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:01.257640 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:01.257605 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:01.358752 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:01.358721 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:02.473878 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:02.473836 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:02.580034 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:02.580001 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:13.982279 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:13.982245 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:14.082423 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:14.082390 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:50.892650 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:50.892616 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 21:59:51.083930 ip-10-0-143-133 kubenswrapper[2553]: I0918 21:59:51.083899 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 22:00:11.536639 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.536607 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 22:00:11.673905 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.673873 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6qs45/must-gather-ksc7n"] Sep 18 22:00:11.677279 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.677263 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs45/must-gather-ksc7n" Sep 18 22:00:11.681912 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.681889 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6qs45\"/\"default-dockercfg-998n8\"" Sep 18 22:00:11.682099 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.681892 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6qs45\"/\"kube-root-ca.crt\"" Sep 18 22:00:11.682099 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.682010 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6qs45\"/\"openshift-service-ca.crt\"" Sep 18 22:00:11.698893 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.698867 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs45/must-gather-ksc7n"] Sep 18 22:00:11.747780 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.747746 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 22:00:11.762740 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.762717 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5dm9\" (UniqueName: \"kubernetes.io/projected/e0d69c80-e109-4f94-a449-5995d1c13a41-kube-api-access-q5dm9\") pod \"must-gather-ksc7n\" (UID: \"e0d69c80-e109-4f94-a449-5995d1c13a41\") " pod="openshift-must-gather-6qs45/must-gather-ksc7n" Sep 18 22:00:11.762817 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.762748 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e0d69c80-e109-4f94-a449-5995d1c13a41-must-gather-output\") pod \"must-gather-ksc7n\" (UID: \"e0d69c80-e109-4f94-a449-5995d1c13a41\") " pod="openshift-must-gather-6qs45/must-gather-ksc7n" Sep 18 22:00:11.864030 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.863996 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5dm9\" (UniqueName: \"kubernetes.io/projected/e0d69c80-e109-4f94-a449-5995d1c13a41-kube-api-access-q5dm9\") pod \"must-gather-ksc7n\" (UID: \"e0d69c80-e109-4f94-a449-5995d1c13a41\") " pod="openshift-must-gather-6qs45/must-gather-ksc7n" Sep 18 22:00:11.864212 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.864036 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e0d69c80-e109-4f94-a449-5995d1c13a41-must-gather-output\") pod \"must-gather-ksc7n\" (UID: \"e0d69c80-e109-4f94-a449-5995d1c13a41\") " pod="openshift-must-gather-6qs45/must-gather-ksc7n" Sep 18 22:00:11.864342 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.864326 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e0d69c80-e109-4f94-a449-5995d1c13a41-must-gather-output\") pod \"must-gather-ksc7n\" (UID: \"e0d69c80-e109-4f94-a449-5995d1c13a41\") " pod="openshift-must-gather-6qs45/must-gather-ksc7n" Sep 18 22:00:11.874481 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:11.874461 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5dm9\" (UniqueName: \"kubernetes.io/projected/e0d69c80-e109-4f94-a449-5995d1c13a41-kube-api-access-q5dm9\") pod \"must-gather-ksc7n\" (UID: \"e0d69c80-e109-4f94-a449-5995d1c13a41\") " pod="openshift-must-gather-6qs45/must-gather-ksc7n" Sep 18 22:00:12.001913 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:12.001876 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs45/must-gather-ksc7n" Sep 18 22:00:12.282125 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:12.282034 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs45/must-gather-ksc7n"] Sep 18 22:00:12.284450 ip-10-0-143-133 kubenswrapper[2553]: W0918 22:00:12.284427 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0d69c80_e109_4f94_a449_5995d1c13a41.slice/crio-089d26cf41e4f01fa59515e98829ae572f19c1b4108183d4b0fe4cddfb92727a WatchSource:0}: Error finding container 089d26cf41e4f01fa59515e98829ae572f19c1b4108183d4b0fe4cddfb92727a: Status 404 returned error can't find the container with id 089d26cf41e4f01fa59515e98829ae572f19c1b4108183d4b0fe4cddfb92727a Sep 18 22:00:12.289191 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:12.289174 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 22:00:12.574056 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:12.573977 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs45/must-gather-ksc7n" event={"ID":"e0d69c80-e109-4f94-a449-5995d1c13a41","Type":"ContainerStarted","Data":"089d26cf41e4f01fa59515e98829ae572f19c1b4108183d4b0fe4cddfb92727a"} Sep 18 22:00:13.580333 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:13.580297 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs45/must-gather-ksc7n" event={"ID":"e0d69c80-e109-4f94-a449-5995d1c13a41","Type":"ContainerStarted","Data":"d0e799020486424236eec3f88d48f6b48f49f291ce58063a24fbd17c55392b0f"} Sep 18 22:00:13.580722 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:13.580347 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs45/must-gather-ksc7n" event={"ID":"e0d69c80-e109-4f94-a449-5995d1c13a41","Type":"ContainerStarted","Data":"1c34190a55fc11050915f3aac0b6752d809cbae6f9c3547a524f4e5671857655"} Sep 18 22:00:13.604006 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:13.603933 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6qs45/must-gather-ksc7n" podStartSLOduration=1.8241514620000001 podStartE2EDuration="2.603917183s" totalImagesPullingTime="779.765721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:13.603339491 +0000 UTC m=+570.580401019" watchObservedRunningTime="2026-09-18 22:00:13.603917183 +0000 UTC m=+570.580978706" Sep 18 22:00:14.687871 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:14.687837 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4wnpc_51ec2d6b-b86c-4b83-92a7-3933a5d6ef46/global-pull-secret-syncer/0.log" Sep 18 22:00:14.873678 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:14.873636 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" Sep 18 22:00:15.053376 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:15.053292 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-133.ec2.internal_5f04635d02a567d20d1ca9921c8ed991/haproxy/0.log" Sep 18 22:00:18.326458 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:18.326423 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 22:00:18.427262 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:18.427231 2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lh2wh_9a1c0627-74c5-42f2-b7e1-2c4e00bf2f03/konnectivity-agent/0.log" limit=1024 Sep 18 22:00:19.710536 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:19.710497 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-pflhp_1f78768e-a13c-4f1a-92ab-6d65b9f296fb/kube-state-metrics/0.log" Sep 18 22:00:19.743341 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:19.743266 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-pflhp_1f78768e-a13c-4f1a-92ab-6d65b9f296fb/kube-rbac-proxy-main/0.log" Sep 18 22:00:19.770220 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:19.770189 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-pflhp_1f78768e-a13c-4f1a-92ab-6d65b9f296fb/kube-rbac-proxy-self/0.log" Sep 18 22:00:20.058543 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.058462 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqwb4_54f00258-b97d-41e8-8c39-4d489f18bc73/node-exporter/0.log" Sep 18 22:00:20.088841 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.088766 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqwb4_54f00258-b97d-41e8-8c39-4d489f18bc73/kube-rbac-proxy/0.log" Sep 18 22:00:20.118044 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.118001 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qqwb4_54f00258-b97d-41e8-8c39-4d489f18bc73/init-textfile/0.log" Sep 18 22:00:20.152397 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.152365 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-flfrb_4a249aae-5477-4870-94f7-9d3709f045e8/kube-rbac-proxy-main/0.log" Sep 18 22:00:20.189068 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.189038 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-flfrb_4a249aae-5477-4870-94f7-9d3709f045e8/kube-rbac-proxy-self/0.log" Sep 18 22:00:20.225215 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.225186 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-flfrb_4a249aae-5477-4870-94f7-9d3709f045e8/openshift-state-metrics/0.log" Sep 18 22:00:20.314136 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.314055 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_44b58801-29e6-42d0-a29d-0a5e8e7e355e/prometheus/0.log" Sep 18 22:00:20.354998 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.354967 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_44b58801-29e6-42d0-a29d-0a5e8e7e355e/config-reloader/0.log" Sep 18 22:00:20.399515 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.399482 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_44b58801-29e6-42d0-a29d-0a5e8e7e355e/thanos-sidecar/0.log" Sep 18 22:00:20.434442 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.434416 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_44b58801-29e6-42d0-a29d-0a5e8e7e355e/kube-rbac-proxy-web/0.log" Sep 18 22:00:20.470284 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.470252 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_44b58801-29e6-42d0-a29d-0a5e8e7e355e/kube-rbac-proxy/0.log" Sep 18 22:00:20.525084 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.525060 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_44b58801-29e6-42d0-a29d-0a5e8e7e355e/kube-rbac-proxy-thanos/0.log" Sep 18 22:00:20.562969 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.562922 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_44b58801-29e6-42d0-a29d-0a5e8e7e355e/init-config-reloader/0.log" Sep 18 22:00:20.605886 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.605855 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-lnzvb_04f39d74-6eff-4f3f-b5e9-cd51c86de16f/prometheus-operator/0.log" Sep 18 22:00:20.629291 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.629265 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-lnzvb_04f39d74-6eff-4f3f-b5e9-cd51c86de16f/kube-rbac-proxy/0.log" Sep 18 22:00:20.807195 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.807164 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59f4649669-5h4n7_fc36e56b-80ec-44d7-8348-0771ca7e307d/thanos-query/0.log" Sep 18 22:00:20.837188 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.837151 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59f4649669-5h4n7_fc36e56b-80ec-44d7-8348-0771ca7e307d/kube-rbac-proxy-web/0.log" Sep 18 22:00:20.866892 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.866815 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59f4649669-5h4n7_fc36e56b-80ec-44d7-8348-0771ca7e307d/kube-rbac-proxy/0.log" Sep 18 22:00:20.896815 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.896787 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59f4649669-5h4n7_fc36e56b-80ec-44d7-8348-0771ca7e307d/prom-label-proxy/0.log" Sep 18 22:00:20.924459 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.924426 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59f4649669-5h4n7_fc36e56b-80ec-44d7-8348-0771ca7e307d/kube-rbac-proxy-rules/0.log" Sep 18 22:00:20.951763 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:20.951718 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59f4649669-5h4n7_fc36e56b-80ec-44d7-8348-0771ca7e307d/kube-rbac-proxy-metrics/0.log" Sep 18 22:00:22.742544 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.742503 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2"] Sep 18 22:00:22.748389 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.748355 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.767766 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.767728 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2"] Sep 18 22:00:22.868500 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.868459 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8887l\" (UniqueName: \"kubernetes.io/projected/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-kube-api-access-8887l\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.868696 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.868517 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-podres\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.868696 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.868572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-lib-modules\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.868696 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.868608 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-sys\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.868808 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.868711 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-proc\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.969355 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.969311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-proc\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.969546 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.969417 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8887l\" (UniqueName: \"kubernetes.io/projected/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-kube-api-access-8887l\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.969546 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.969452 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-podres\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.969546 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.969477 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-lib-modules\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.969546 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.969510 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-sys\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.969793 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.969639 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-sys\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.969793 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.969721 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-proc\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.970166 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.970137 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-lib-modules\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.970270 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.970137 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-podres\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:22.979106 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:22.979085 2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8887l\" (UniqueName: \"kubernetes.io/projected/bd95e5bf-5f5e-4c08-ba24-c367b3ec7865-kube-api-access-8887l\") pod \"perf-node-gather-daemonset-9kkx2\" (UID: \"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865\") " pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:23.062535 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:23.062430 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:23.361062 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:23.361031 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2"] Sep 18 22:00:23.370393 ip-10-0-143-133 kubenswrapper[2553]: W0918 22:00:23.370363 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbd95e5bf_5f5e_4c08_ba24_c367b3ec7865.slice/crio-cc1af8592be4fa1518155b8142d4db45c433d443bf94bbaf1857f9c4de4617ee WatchSource:0}: Error finding container cc1af8592be4fa1518155b8142d4db45c433d443bf94bbaf1857f9c4de4617ee: Status 404 returned error can't find the container with id cc1af8592be4fa1518155b8142d4db45c433d443bf94bbaf1857f9c4de4617ee Sep 18 22:00:23.650804 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:23.650714 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" event={"ID":"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865","Type":"ContainerStarted","Data":"d3ace5d827d63f612e0f60c787a9fdecea5ad2b088533927e2199e82b63c3fe3"} Sep 18 22:00:23.650804 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:23.650794 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" event={"ID":"bd95e5bf-5f5e-4c08-ba24-c367b3ec7865","Type":"ContainerStarted","Data":"cc1af8592be4fa1518155b8142d4db45c433d443bf94bbaf1857f9c4de4617ee"} Sep 18 22:00:23.651029 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:23.650852 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:23.680872 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:23.680821 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" podStartSLOduration=1.680804835 podStartE2EDuration="1.680804835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:23.67855837 +0000 UTC m=+580.655619915" watchObservedRunningTime="2026-09-18 22:00:23.680804835 +0000 UTC m=+580.657866359" Sep 18 22:00:23.974905 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:23.974810 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-mqzrq_26b36d06-8425-4a02-a695-66dd64d35385/volume-data-source-validator/0.log" Sep 18 22:00:25.118304 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:25.118255 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-shllc_7249b8d1-5008-48e4-94ea-079001c7a03e/dns/0.log" Sep 18 22:00:25.148462 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:25.148433 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-shllc_7249b8d1-5008-48e4-94ea-079001c7a03e/kube-rbac-proxy/0.log" Sep 18 22:00:25.214961 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:25.214937 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dkbkd_e07c0afd-584c-49f8-a8d0-46497506f2b6/dns-node-resolver/0.log" Sep 18 22:00:25.938268 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:25.938241 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kf47m_1b80f305-7db1-4458-9919-4a956ac98551/node-ca/0.log" Sep 18 22:00:26.976977 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:26.976950 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5b7ff75b-tkbrm_d915466a-af7f-49fc-84e8-38874961c286/router/0.log" Sep 18 22:00:27.421675 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:27.421645 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ksgsm_1f4ee511-aedd-4e1d-8a06-f427ca0f2f03/serve-healthcheck-canary/0.log" Sep 18 22:00:27.984896 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:27.984864 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-28h8h_84bca18d-4a50-4150-b87f-bed5cc8f7d6c/insights-operator/1.log" Sep 18 22:00:27.985470 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:27.985341 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-28h8h_84bca18d-4a50-4150-b87f-bed5cc8f7d6c/insights-operator/0.log" Sep 18 22:00:28.109114 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:28.109077 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j5czk_ecb088c4-7423-42b0-bb4f-586085cfee17/kube-rbac-proxy/0.log" Sep 18 22:00:28.135476 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:28.135450 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j5czk_ecb088c4-7423-42b0-bb4f-586085cfee17/exporter/0.log" Sep 18 22:00:28.162912 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:28.162886 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j5czk_ecb088c4-7423-42b0-bb4f-586085cfee17/extractor/0.log" Sep 18 22:00:29.665551 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:29.665527 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6qs45/perf-node-gather-daemonset-9kkx2" Sep 18 22:00:36.079242 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:36.079208 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-b97hx_3e0597be-3aa5-45c1-84a3-4049e18fee3a/kube-storage-version-migrator-operator/1.log" Sep 18 22:00:36.081115 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:36.081089 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-b97hx_3e0597be-3aa5-45c1-84a3-4049e18fee3a/kube-storage-version-migrator-operator/0.log" Sep 18 22:00:37.213443 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:37.213406 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-42npz_e1074956-ac86-412f-85b2-55a907fdac83/kube-multus/0.log" Sep 18 22:00:37.731658 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:37.731629 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsdpg_ef2b78c9-2057-4797-849a-d88a0ceccbab/kube-multus-additional-cni-plugins/0.log" Sep 18 22:00:37.763646 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:37.763618 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsdpg_ef2b78c9-2057-4797-849a-d88a0ceccbab/egress-router-binary-copy/0.log" Sep 18 22:00:37.792048 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:37.792020 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsdpg_ef2b78c9-2057-4797-849a-d88a0ceccbab/cni-plugins/0.log" Sep 18 22:00:37.831103 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:37.831085 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsdpg_ef2b78c9-2057-4797-849a-d88a0ceccbab/bond-cni-plugin/0.log" Sep 18 22:00:37.866025 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:37.865994 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsdpg_ef2b78c9-2057-4797-849a-d88a0ceccbab/routeoverride-cni/0.log" Sep 18 22:00:37.894934 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:37.894903 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsdpg_ef2b78c9-2057-4797-849a-d88a0ceccbab/whereabouts-cni-bincopy/0.log" Sep 18 22:00:37.930365 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:37.930336 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsdpg_ef2b78c9-2057-4797-849a-d88a0ceccbab/whereabouts-cni/0.log" Sep 18 22:00:38.012426 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:38.012343 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ndv9n_2de0f77b-b8af-4621-99bb-86b1167904c1/network-metrics-daemon/0.log" Sep 18 22:00:38.045979 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:38.045955 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ndv9n_2de0f77b-b8af-4621-99bb-86b1167904c1/kube-rbac-proxy/0.log" Sep 18 22:00:39.720193 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:39.720163 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lcc96_9a4620a6-8a39-4f96-a1f0-a2841608b7b8/ovn-controller/0.log" Sep 18 22:00:39.759488 ip-10-0-143-133 kubenswrapper[2553]: I0918 22:00:39.759458 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lcc96_9a4620a6-8a39-4f96-a1f0-a2841608b7b8/ovn-acl-logging/0.log"