Sep 17 21:58:56.018376 ip-10-0-133-200 systemd[1]: Starting Kubernetes Kubelet... Sep 17 21:58:59.591927 ip-10-0-133-200 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 21:58:59.591927 ip-10-0-133-200 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 21:58:59.591927 ip-10-0-133-200 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 21:58:59.591927 ip-10-0-133-200 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 21:58:59.591927 ip-10-0-133-200 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 21:58:59.592624 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.592022 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 21:58:59.595299 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595281 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 21:58:59.595299 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595298 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595302 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595305 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595308 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595311 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595313 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595316 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595319 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595321 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595324 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595327 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595329 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595332 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595335 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595337 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595339 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595342 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595344 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595347 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595350 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 21:58:59.595364 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595352 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595355 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595357 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595360 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595362 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595370 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595375 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595379 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595382 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595384 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595387 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595390 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595393 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595396 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595399 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595401 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595403 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595406 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595408 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 21:58:59.595833 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595411 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595413 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595415 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595418 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595420 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595422 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595425 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595427 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595430 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595432 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595434 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595438 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595440 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595443 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595445 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595448 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595453 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595457 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595461 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 21:58:59.596307 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595465 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595468 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595471 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595474 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595477 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595479 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595482 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595484 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595487 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595489 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595492 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595494 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595497 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595499 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595502 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595504 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595506 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595509 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595512 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 21:58:59.596767 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595515 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595517 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595520 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595522 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595525 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595527 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595530 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595532 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595534 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595539 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595542 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595545 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595547 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595549 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595552 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595554 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595557 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595559 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595562 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595564 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 21:58:59.597233 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.595567 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596258 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596266 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596269 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596272 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596274 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596277 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596280 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596282 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596285 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596291 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596293 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596296 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596299 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596301 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596304 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596306 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596309 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596311 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 21:58:59.597703 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596314 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596318 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596321 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596324 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596327 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596329 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596332 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596334 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596337 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596339 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596342 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596346 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596350 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596354 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596357 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596360 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596363 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596365 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596368 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 21:58:59.598232 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596371 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596373 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596376 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596378 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596381 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596384 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596386 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596389 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596391 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596393 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596395 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596398 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596400 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596403 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596405 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596408 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596411 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596414 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596416 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596419 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 21:58:59.598692 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596421 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596423 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596426 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596428 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596431 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596433 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596436 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596438 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596440 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596443 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596445 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596447 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596450 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596452 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596454 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596457 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596459 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596461 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596464 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596467 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 21:58:59.599191 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596469 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596472 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596474 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596476 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596480 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596483 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596487 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596490 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596492 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596495 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596497 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596500 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596502 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596506 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596509 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596512 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596514 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596517 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596519 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596522 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 21:58:59.599670 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596525 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596528 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596879 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596884 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596887 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596890 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596892 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596895 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596897 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596900 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596903 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596922 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596925 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596927 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596930 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596932 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596935 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596937 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596940 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 21:58:59.600171 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596943 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596945 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596948 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596951 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596953 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596955 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596958 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596961 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596963 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596966 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596968 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596970 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596973 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596975 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596980 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596983 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596986 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596988 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596991 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596993 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 21:58:59.600655 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596996 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.596998 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597001 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597003 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597006 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597008 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597011 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597013 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597018 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597022 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597025 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597028 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597031 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597034 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597036 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597039 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597041 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597043 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597046 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597049 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 21:58:59.601150 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597051 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597054 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597056 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597059 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597061 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597064 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597067 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597070 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597073 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597075 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597078 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597080 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597083 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597085 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597089 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597093 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597095 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597099 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597101 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597104 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 21:58:59.601621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597108 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597110 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597113 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597115 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597118 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597121 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597124 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597126 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597129 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597132 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597134 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597136 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597139 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597142 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597144 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597147 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597149 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597152 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597157 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597160 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 21:58:59.602143 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597163 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597165 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597239 2568 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597273 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597279 2568 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597283 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597287 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597290 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597294 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597299 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597304 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597307 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597312 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597315 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597318 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597321 2568 flags.go:64] FLAG: --cgroup-root="" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597324 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597327 2568 flags.go:64] FLAG: --client-ca-file="" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597330 2568 flags.go:64] FLAG: --cloud-provider="external" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597333 2568 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597337 2568 flags.go:64] FLAG: --cluster-domain="" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597340 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597344 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597347 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 21:58:59.602621 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597350 2568 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597354 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597357 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597360 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597363 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597366 2568 flags.go:64] FLAG: --contention-profiling="false" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597371 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597374 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597376 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597379 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597383 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597386 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597389 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597392 2568 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597395 2568 flags.go:64] FLAG: --enable-server="true" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597398 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597402 2568 flags.go:64] FLAG: --event-burst="100" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597405 2568 flags.go:64] FLAG: --event-qps="50" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597408 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597411 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597415 2568 flags.go:64] FLAG: --eviction-hard="" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597419 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597422 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597425 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597427 2568 flags.go:64] FLAG: --eviction-soft="" Sep 17 21:58:59.603201 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597430 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597433 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597436 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597439 2568 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597442 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597444 2568 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597447 2568 flags.go:64] FLAG: --feature-gates="" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597451 2568 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597453 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597456 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597459 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597462 2568 flags.go:64] FLAG: --healthz-port="10248" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597465 2568 flags.go:64] FLAG: --help="false" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597469 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597472 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597475 2568 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597478 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597481 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597484 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597487 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597490 2568 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597493 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597496 2568 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 21:58:59.603825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597498 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597501 2568 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597504 2568 flags.go:64] FLAG: --kube-reserved="" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597507 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597511 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597514 2568 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597517 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597520 2568 flags.go:64] FLAG: --lock-file="" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597522 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597526 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597528 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597534 2568 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597536 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597539 2568 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597542 2568 flags.go:64] FLAG: --logging-format="text" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597545 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597548 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597550 2568 flags.go:64] FLAG: --manifest-url="" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597553 2568 flags.go:64] FLAG: --manifest-url-header="" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597557 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597560 2568 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597564 2568 flags.go:64] FLAG: --max-pods="110" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597569 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597571 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597574 2568 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 21:58:59.604459 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597577 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597580 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597583 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597585 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597592 2568 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597595 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597598 2568 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597601 2568 flags.go:64] FLAG: --pod-cidr="" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597604 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597609 2568 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597612 2568 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597615 2568 flags.go:64] FLAG: --pods-per-core="0" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597619 2568 flags.go:64] FLAG: --port="10250" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597622 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597625 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04bd604d2ed587a6d" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597628 2568 flags.go:64] FLAG: --qos-reserved="" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597631 2568 flags.go:64] FLAG: --read-only-port="10255" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597634 2568 flags.go:64] FLAG: --register-node="true" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597637 2568 flags.go:64] FLAG: --register-with-taints="" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597645 2568 flags.go:64] FLAG: --registry-burst="10" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597648 2568 flags.go:64] FLAG: --registry-qps="5" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597650 2568 flags.go:64] FLAG: --reserved-cpus="" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597653 2568 flags.go:64] FLAG: --reserved-memory="" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597657 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597660 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 21:58:59.605088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597663 2568 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597666 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597668 2568 flags.go:64] FLAG: --runonce="false" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597671 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597675 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597678 2568 flags.go:64] FLAG: --seccomp-default="false" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597681 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597683 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597686 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597689 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597692 2568 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597695 2568 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597697 2568 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597700 2568 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597703 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597706 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597709 2568 flags.go:64] FLAG: --system-cgroups="" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597712 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597717 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597723 2568 flags.go:64] FLAG: --tls-cert-file="" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597726 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597731 2568 flags.go:64] FLAG: --tls-min-version="" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597733 2568 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597736 2568 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597739 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 21:58:59.605796 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597742 2568 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597745 2568 flags.go:64] FLAG: --v="2" Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597748 2568 flags.go:64] FLAG: --version="false" Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597752 2568 flags.go:64] FLAG: --vmodule="" Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597756 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.597759 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597871 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597875 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597878 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597882 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597885 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597889 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597892 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597894 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597897 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597900 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597903 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597926 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597929 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597932 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 21:58:59.606497 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597936 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597939 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597942 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597945 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597948 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597950 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597954 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597957 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597960 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597962 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597965 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597968 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597970 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597973 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597975 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597978 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597981 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597983 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597986 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597988 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 21:58:59.607096 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597991 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597994 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.597996 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598001 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598003 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598006 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598008 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598010 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598013 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598015 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598018 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598021 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598023 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598026 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598028 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598031 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598033 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598036 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598039 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598042 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 21:58:59.607639 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598044 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598047 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598051 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598054 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598057 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598060 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598063 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598066 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598068 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598071 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598074 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598077 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598079 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598082 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598085 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598089 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598091 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598094 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598097 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598099 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 21:58:59.608245 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598102 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598104 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598107 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598110 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598112 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598115 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598117 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598119 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598122 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598124 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598128 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598131 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598133 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598136 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598139 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598141 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598144 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598146 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598149 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598151 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 21:58:59.608798 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598154 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598156 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598158 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598161 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.598163 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.598849 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.606739 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.606754 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.606775 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.606781 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606836 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606842 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606846 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606849 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606852 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 21:58:59.609361 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606855 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606858 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606861 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606863 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606866 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606868 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606871 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606874 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606877 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606880 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606882 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606885 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606888 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606890 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606893 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606895 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606898 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606900 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606904 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606925 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 21:58:59.609748 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606928 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606931 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606934 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606937 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606942 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606944 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606947 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606949 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606952 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606954 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606957 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606961 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606965 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606968 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606971 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606973 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606976 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606979 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606981 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 21:58:59.610324 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606984 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606986 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606989 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606992 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606995 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.606998 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607000 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607003 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607005 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607008 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607010 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607014 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607017 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607020 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607023 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607026 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607029 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607031 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607034 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607037 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 21:58:59.610823 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607040 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607042 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607044 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607047 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607050 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607052 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607055 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607057 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607059 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607062 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607065 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607067 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607069 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607073 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607077 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607080 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607082 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607085 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607087 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 21:58:59.611310 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607090 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607092 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607095 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607098 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607100 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607103 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607105 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607108 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607111 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607114 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607117 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607119 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607122 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607125 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607127 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 21:58:59.611766 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607129 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.607134 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607245 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607249 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607253 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607255 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607258 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607261 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607263 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607266 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607268 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607272 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607274 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607277 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 21:58:59.612166 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607280 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607283 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607286 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607288 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607291 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607293 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607295 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607298 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607300 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607303 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607305 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607308 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607310 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607313 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607316 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607318 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607321 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607324 2568 feature_gate.go:328] unrecognized feature gate: Example Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607326 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607329 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607331 2568 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 21:58:59.612506 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607334 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607336 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607338 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607341 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607343 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607346 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607348 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607351 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607354 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607356 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607359 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607361 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607365 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607368 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607371 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607374 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607377 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607379 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607382 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 21:58:59.613017 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607386 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607388 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607391 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607393 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607396 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607399 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607402 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607404 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607406 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607409 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607412 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607414 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607417 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607419 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607422 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607424 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607427 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607429 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607431 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607434 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 21:58:59.613469 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607436 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607439 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607441 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607444 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607446 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607448 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607451 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607453 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607456 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607458 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607461 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607465 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607467 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607470 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607472 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607475 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607477 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607480 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607483 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 21:58:59.613963 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607485 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607488 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607490 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607493 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607496 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607499 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607501 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:58:59.607503 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.607508 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.607630 2568 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.609893 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.610860 2568 server.go:1019] "Starting client certificate rotation" Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.610942 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 21:58:59.614419 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.611842 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 21:58:59.616192 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.616174 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 21:58:59.618080 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.618059 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 21:58:59.623580 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.623561 2568 log.go:25] "Validated CRI v1 runtime API" Sep 17 21:58:59.625243 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.625226 2568 log.go:25] "Validated CRI v1 image API" Sep 17 21:58:59.626680 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.626639 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 21:58:59.628847 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.628824 2568 fs.go:135] Filesystem UUIDs: map[12059451-ae93-40a6-8a2d-a949bfe3510c:/dev/nvme0n1p3 4b3b5bb4-8b88-4b27-b344-5e63aa784cd2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 17 21:58:59.629027 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.628847 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 21:58:59.633971 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.633848 2568 manager.go:216] Machine: {Timestamp:2026-09-17 21:58:59.633378701 +0000 UTC m=+1.984585335 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091991 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec210115154723f156d8568c63298326 SystemUUID:ec210115-1547-23f1-56d8-568c63298326 BootID:c8e4a5c0-50f3-43ba-a88f-1b2cd2c1bf32 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:db:a5:65:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:db:a5:65:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:3f:28:8b:43:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 21:58:59.633971 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.633964 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 21:58:59.634097 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.634040 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 21:58:59.635814 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.635787 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 21:58:59.635968 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.635818 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 21:58:59.637363 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.637352 2568 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 21:58:59.637400 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.637366 2568 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 21:58:59.637400 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.637379 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 21:58:59.637400 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.637389 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 21:58:59.637480 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.637456 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 21:58:59.641047 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641032 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 21:58:59.641340 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641328 2568 state_mem.go:36] "Initialized new in-memory state store" Sep 17 21:58:59.641455 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641446 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 21:58:59.641489 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641478 2568 kubelet.go:486] "Attempting to sync node with API server" Sep 17 21:58:59.641489 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641488 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 21:58:59.641539 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641501 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 21:58:59.641539 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641512 2568 kubelet.go:398] "Adding apiserver pod source" Sep 17 21:58:59.641539 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641521 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 21:58:59.641897 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641883 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 21:58:59.641989 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.641922 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 21:58:59.645303 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.645277 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 21:58:59.647921 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.647886 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 21:58:59.648002 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.647935 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 21:58:59.649212 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649199 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 21:58:59.649269 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649221 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 21:58:59.649269 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649228 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 21:58:59.649269 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649233 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 21:58:59.649269 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649242 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 21:58:59.649269 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649260 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 21:58:59.649417 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649281 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 21:58:59.649417 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649289 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 21:58:59.649417 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649295 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 21:58:59.649417 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649301 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 21:58:59.649417 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649309 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 21:58:59.649417 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649314 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 21:58:59.649417 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649336 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 21:58:59.649417 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.649344 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 21:58:59.650171 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.650140 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 21:58:59.650276 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.650165 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 21:58:59.651656 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.651639 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 21:58:59.653186 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.653173 2568 server.go:1268] "Started kubelet" Sep 17 21:58:59.653273 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.653244 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 21:58:59.653310 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.653257 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 21:58:59.653347 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.653326 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 21:58:59.654096 ip-10-0-133-200 systemd[1]: Started Kubernetes Kubelet. Sep 17 21:58:59.654629 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.654537 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 21:58:59.655072 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.655060 2568 server.go:310] "Adding debug handlers to kubelet server" Sep 17 21:58:59.661981 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.661961 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 21:58:59.662388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.662370 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 21:58:59.662388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.662383 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 21:58:59.662682 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.662643 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:58:59.663468 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.663443 2568 factory.go:153] Registering CRI-O factory Sep 17 21:58:59.663468 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.663461 2568 factory.go:223] Registration of the crio container factory successfully Sep 17 21:58:59.663585 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.663513 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 21:58:59.663585 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.663522 2568 factory.go:55] Registering systemd factory Sep 17 21:58:59.663585 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.663530 2568 factory.go:223] Registration of the systemd container factory successfully Sep 17 21:58:59.663585 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.663547 2568 factory.go:103] Registering Raw factory Sep 17 21:58:59.663585 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.663558 2568 manager.go:1196] Started watching for new ooms in manager Sep 17 21:58:59.663994 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.663983 2568 manager.go:349] Starting recovery of all containers Sep 17 21:58:59.668441 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.668425 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 21:58:59.668441 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.668428 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 21:58:59.668575 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.668456 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 21:58:59.668628 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.668607 2568 reconstruct.go:97] "Volume reconstruction finished" Sep 17 21:58:59.668628 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.668615 2568 reconciler.go:29] "Reconciler: start to sync state" Sep 17 21:58:59.669267 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.669243 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jgbr7" Sep 17 21:58:59.685901 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.685714 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 21:58:59.686025 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.685950 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 21:58:59.686293 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.686274 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jgbr7" Sep 17 21:58:59.686747 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.686724 2568 manager.go:354] Recovery completed Sep 17 21:58:59.692140 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.692125 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 21:58:59.693815 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.693797 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientMemory" Sep 17 21:58:59.693876 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.693826 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 21:58:59.693876 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.693836 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientPID" Sep 17 21:58:59.694393 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.694379 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 21:58:59.694393 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.694392 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 21:58:59.694490 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.694407 2568 state_mem.go:36] "Initialized new in-memory state store" Sep 17 21:58:59.694490 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.694421 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 21:58:59.695142 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.695126 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientMemory" Sep 17 21:58:59.695187 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.695157 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 21:58:59.695187 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.695170 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientPID" Sep 17 21:58:59.695544 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.695532 2568 policy_none.go:49] "None policy: Start" Sep 17 21:58:59.695601 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.695547 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 21:58:59.695601 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.695557 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 21:58:59.696499 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.696488 2568 policy_none.go:47] "Start" Sep 17 21:58:59.738517 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.738496 2568 manager.go:337] "Starting Device Plugin manager" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.738541 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.738556 2568 server.go:87] "Starting device plugin registration server" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.738822 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.738846 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.738933 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.739028 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.739038 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.739673 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 21:58:59.749212 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.739716 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:58:59.838988 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.838947 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 21:58:59.840131 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.840105 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientMemory" Sep 17 21:58:59.840210 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.840147 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 21:58:59.840210 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.840163 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientPID" Sep 17 21:58:59.840210 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.840199 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.849060 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.849017 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.849060 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.849040 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-200.ec2.internal\": node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:58:59.854782 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.854750 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 21:58:59.856360 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.856337 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 21:58:59.856465 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.856395 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 21:58:59.856465 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.856420 2568 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 21:58:59.856547 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.856466 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 21:58:59.859794 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.859778 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 21:58:59.864882 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.864867 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:58:59.957130 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.957095 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal"] Sep 17 21:58:59.957265 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.957176 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 21:58:59.958159 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.958131 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientMemory" Sep 17 21:58:59.958159 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.958160 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 21:58:59.958292 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.958176 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientPID" Sep 17 21:58:59.960314 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.960301 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 21:58:59.960453 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.960441 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.960489 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.960471 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 21:58:59.961087 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.961071 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientMemory" Sep 17 21:58:59.961170 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.961101 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 21:58:59.961170 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.961114 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientPID" Sep 17 21:58:59.961170 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.961116 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientMemory" Sep 17 21:58:59.961170 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.961140 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 21:58:59.961170 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.961153 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientPID" Sep 17 21:58:59.963237 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.963221 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.963336 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.963249 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 21:58:59.963959 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.963941 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientMemory" Sep 17 21:58:59.964056 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.963971 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 21:58:59.964056 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.963982 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeHasSufficientPID" Sep 17 21:58:59.965367 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.965350 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:58:59.969721 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.969705 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c838c3bd5faca9499f3e40b6543bbed-config\") pod \"kube-apiserver-proxy-ip-10-0-133-200.ec2.internal\" (UID: \"4c838c3bd5faca9499f3e40b6543bbed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.969804 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.969727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b52ba0411fe5bd8aeab626e963fd13fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal\" (UID: \"b52ba0411fe5bd8aeab626e963fd13fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.969804 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:58:59.969746 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b52ba0411fe5bd8aeab626e963fd13fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal\" (UID: \"b52ba0411fe5bd8aeab626e963fd13fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.978435 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.978418 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-200.ec2.internal\" not found" node="ip-10-0-133-200.ec2.internal" Sep 17 21:58:59.982652 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:58:59.982637 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-200.ec2.internal\" not found" node="ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.065967 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:00.065939 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:59:00.070197 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.070185 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c838c3bd5faca9499f3e40b6543bbed-config\") pod \"kube-apiserver-proxy-ip-10-0-133-200.ec2.internal\" (UID: \"4c838c3bd5faca9499f3e40b6543bbed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.070253 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.070240 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b52ba0411fe5bd8aeab626e963fd13fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal\" (UID: \"b52ba0411fe5bd8aeab626e963fd13fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.070297 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.070288 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b52ba0411fe5bd8aeab626e963fd13fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal\" (UID: \"b52ba0411fe5bd8aeab626e963fd13fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.070344 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.070244 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c838c3bd5faca9499f3e40b6543bbed-config\") pod \"kube-apiserver-proxy-ip-10-0-133-200.ec2.internal\" (UID: \"4c838c3bd5faca9499f3e40b6543bbed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.070344 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.070242 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b52ba0411fe5bd8aeab626e963fd13fc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal\" (UID: \"b52ba0411fe5bd8aeab626e963fd13fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.070412 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.070342 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b52ba0411fe5bd8aeab626e963fd13fc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal\" (UID: \"b52ba0411fe5bd8aeab626e963fd13fc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.166790 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:00.166717 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:59:00.267378 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:00.267341 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:59:00.281773 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.281755 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.287145 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.286967 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.368131 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:00.368097 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:59:00.468738 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:00.468661 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:59:00.569158 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:00.569135 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:59:00.611465 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.611440 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 21:59:00.611967 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.611575 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 21:59:00.670187 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:00.670162 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:59:00.691336 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.691303 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 21:53:59 +0000 UTC" deadline="2028-07-05 06:50:01.997167926 +0000 UTC" Sep 17 21:59:00.691336 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.691333 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15752h51m1.305838304s" Sep 17 21:59:00.746247 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.746220 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 21:59:00.770235 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.770211 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 21:59:00.770371 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:00.770230 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-200.ec2.internal\" not found" Sep 17 21:59:00.798741 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.798714 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 21:59:00.863795 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.863765 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.876545 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.876523 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 21:59:00.877536 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.877520 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" Sep 17 21:59:00.885687 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.885672 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 21:59:00.904358 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:00.904322 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52ba0411fe5bd8aeab626e963fd13fc.slice/crio-8e0edb1b05bb3c7460e857f15716cedaffa8f4aa9f50048a0ab54a5ae99cd28d WatchSource:0}: Error finding container 8e0edb1b05bb3c7460e857f15716cedaffa8f4aa9f50048a0ab54a5ae99cd28d: Status 404 returned error can't find the container with id 8e0edb1b05bb3c7460e857f15716cedaffa8f4aa9f50048a0ab54a5ae99cd28d Sep 17 21:59:00.904971 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:00.904948 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c838c3bd5faca9499f3e40b6543bbed.slice/crio-c101d003bb4879edb686af8d8c10e9d1b6e21d3bde867dd221f8eaceb3516e04 WatchSource:0}: Error finding container c101d003bb4879edb686af8d8c10e9d1b6e21d3bde867dd221f8eaceb3516e04: Status 404 returned error can't find the container with id c101d003bb4879edb686af8d8c10e9d1b6e21d3bde867dd221f8eaceb3516e04 Sep 17 21:59:00.909591 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:00.909577 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 21:59:01.641787 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.641699 2568 apiserver.go:52] "Watching apiserver" Sep 17 21:59:01.650324 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.650284 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 21:59:01.651120 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.651086 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-cd9k8","kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8","openshift-dns/node-resolver-fm2vp","openshift-network-diagnostics/network-check-target-88wh9","openshift-ovn-kubernetes/ovnkube-node-n26r9","kube-system/global-pull-secret-syncer-6rktt","openshift-cluster-node-tuning-operator/tuned-b28sd","openshift-image-registry/node-ca-pvtjj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal","openshift-multus/multus-additional-cni-plugins-s2n8p","openshift-multus/multus-wbvsn","openshift-multus/network-metrics-daemon-hbsxf","openshift-network-operator/iptables-alerter-kbz9w"] Sep 17 21:59:01.653622 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.653590 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.656339 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.656081 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:01.656339 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.656201 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:01.656549 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.656528 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n687c\"" Sep 17 21:59:01.656665 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.656641 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 21:59:01.656978 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.656958 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 21:59:01.659018 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.659001 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.661080 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.661058 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.661980 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.661960 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 21:59:01.662169 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.662151 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 21:59:01.662519 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.662366 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n2kq8\"" Sep 17 21:59:01.662577 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.662554 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 21:59:01.662874 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.662853 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 21:59:01.663171 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.663150 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 21:59:01.663370 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.663352 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 21:59:01.663942 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.663601 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wrddd\"" Sep 17 21:59:01.663942 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.663726 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 21:59:01.663942 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.663784 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 21:59:01.664151 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.663976 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.665731 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.665711 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.665869 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.665785 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:01.666528 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.666507 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 21:59:01.666620 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.666588 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 21:59:01.666812 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.666792 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zxx5t\"" Sep 17 21:59:01.668013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.667994 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:01.670158 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.670135 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 21:59:01.670483 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.670465 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 21:59:01.670707 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.670689 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qfrds\"" Sep 17 21:59:01.671150 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.671115 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.673010 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.672991 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.673844 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.673819 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 21:59:01.673844 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.673822 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 21:59:01.674650 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.674450 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 21:59:01.675432 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675097 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 21:59:01.675432 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675173 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d2bsb\"" Sep 17 21:59:01.675432 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675303 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 21:59:01.675432 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675353 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 21:59:01.675432 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675391 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:01.675811 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.675450 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:01.675811 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675653 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 21:59:01.675811 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675670 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 21:59:01.676029 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675879 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 21:59:01.676029 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.675896 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rbvld\"" Sep 17 21:59:01.676340 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.676248 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 21:59:01.677431 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.677410 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.678388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-sys\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.678388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-cni-binary-copy\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.678388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-registration-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.678388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-cni-netd\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.678388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovnkube-config\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.678388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678301 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-kubernetes\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.678388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-tuned\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.678388 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-var-lib-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678389 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-run-ovn-kubernetes\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/326372c5-d53f-4ff7-ad47-aa1dd50257d1-konnectivity-ca\") pod \"konnectivity-agent-cd9k8\" (UID: \"326372c5-d53f-4ff7-ad47-aa1dd50257d1\") " pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678462 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-modprobe-d\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysctl-conf\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678528 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-system-cni-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678552 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfmx2\" (UniqueName: \"kubernetes.io/projected/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-kube-api-access-jfmx2\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-kubelet-config\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678620 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysctl-d\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.678666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovnkube-script-lib\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678694 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgtfj\" (UniqueName: \"kubernetes.io/projected/fe4903e3-8151-4d31-97a9-e51c2f97e867-kube-api-access-rgtfj\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678707 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-run\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678722 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-var-lib-kubelet\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-cnibin\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678779 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-etc-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678805 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-cnibin\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-conf-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.678959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.679039 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679071 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679114 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbzr4\" (UniqueName: \"kubernetes.io/projected/22d31356-96f2-41e3-a543-eb7c63146aef-kube-api-access-pbzr4\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679145 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-k8s-cni-cncf-io\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679183 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-cni-bin\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-hostroot\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-kubelet\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-ovn\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679351 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysconfig\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-cni-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-socket-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.679461 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679465 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/326372c5-d53f-4ff7-ad47-aa1dd50257d1-agent-certs\") pod \"konnectivity-agent-cd9k8\" (UID: \"326372c5-d53f-4ff7-ad47-aa1dd50257d1\") " pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-systemd\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-etc-kubernetes\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679549 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-log-socket\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679602 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-lib-modules\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5288722d-1473-47cb-8cac-a629e5fed2a6-tmp\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-slash\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-daemon-config\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679734 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-multus-certs\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-device-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679826 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-cni-bin\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-host\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.679951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdlgz\" (UniqueName: \"kubernetes.io/projected/5288722d-1473-47cb-8cac-a629e5fed2a6-kube-api-access-rdlgz\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.680013 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-system-cni-dir\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680045 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680069 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680147 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-systemd-units\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680182 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680205 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-env-overrides\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovn-node-metrics-cert\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-systemd\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-netns\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-cni-multus\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pcch\" (UniqueName: \"kubernetes.io/projected/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-kube-api-access-7pcch\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-sys-fs\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-node-log\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680392 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-socket-dir-parent\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-kubelet\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9blk\" (UniqueName: \"kubernetes.io/projected/0f735753-7333-48b5-9d5f-6f4dda9f29e1-kube-api-access-w9blk\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:01.680691 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680465 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-dbus\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.681623 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.680489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-run-netns\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.683901 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.683273 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fjdmf\"" Sep 17 21:59:01.683901 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.683592 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 21:59:01.683901 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.683797 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 21:59:01.687930 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.685022 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 21:59:01.687930 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.685528 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5r7hz\"" Sep 17 21:59:01.687930 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.686093 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 21:59:01.687930 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.686097 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 21:59:01.769646 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.769621 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 21:59:01.781175 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-env-overrides\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.781175 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovn-node-metrics-cert\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.781400 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781216 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/274f5888-75df-49d0-9c3b-cd4dbb188489-iptables-alerter-script\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.781400 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-systemd\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.781400 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781299 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-systemd\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.781562 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-netns\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.781562 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-cni-multus\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.781562 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pcch\" (UniqueName: \"kubernetes.io/projected/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-kube-api-access-7pcch\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.781562 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781537 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-sys-fs\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-node-log\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781584 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-netns\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781606 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-hosts-file\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781644 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-cni-multus\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-socket-dir-parent\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-kubelet\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781720 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9blk\" (UniqueName: \"kubernetes.io/projected/0f735753-7333-48b5-9d5f-6f4dda9f29e1-kube-api-access-w9blk\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:01.781777 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781745 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-env-overrides\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781748 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-dbus\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781811 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-run-netns\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781837 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308aba24-dfd1-4096-8bb5-332d01c807c8-host\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grjzt\" (UniqueName: \"kubernetes.io/projected/308aba24-dfd1-4096-8bb5-332d01c807c8-kube-api-access-grjzt\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781880 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-sys\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781885 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-dbus\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-cni-binary-copy\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-sys-fs\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-registration-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781951 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-node-log\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781957 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-cni-netd\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781972 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovnkube-config\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781980 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-run-netns\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.781999 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/308aba24-dfd1-4096-8bb5-332d01c807c8-serviceca\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782064 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-kubernetes\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.782166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-tuned\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-var-lib-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-run-ovn-kubernetes\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/326372c5-d53f-4ff7-ad47-aa1dd50257d1-konnectivity-ca\") pod \"konnectivity-agent-cd9k8\" (UID: \"326372c5-d53f-4ff7-ad47-aa1dd50257d1\") " pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-socket-dir-parent\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782138 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-modprobe-d\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782156 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysctl-conf\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-system-cni-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782187 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfmx2\" (UniqueName: \"kubernetes.io/projected/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-kube-api-access-jfmx2\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782202 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-kubelet-config\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782209 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-modprobe-d\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-tmp-dir\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782241 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-registration-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782249 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysctl-d\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovnkube-script-lib\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.782805 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782299 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-cni-binary-copy\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782350 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-sys\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782378 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-kubelet-config\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782403 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-kubelet\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782495 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysctl-conf\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782526 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-system-cni-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782698 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovnkube-config\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782732 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovnkube-script-lib\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782751 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysctl-d\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782756 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgtfj\" (UniqueName: \"kubernetes.io/projected/fe4903e3-8151-4d31-97a9-e51c2f97e867-kube-api-access-rgtfj\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-run\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782788 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782264 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-cni-netd\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-var-lib-kubelet\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.782813 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782833 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-var-lib-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-cnibin\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-etc-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.783672 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782870 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-cnibin\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782878 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-kubernetes\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-cnibin\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.782922 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret podName:1321b96a-f1b2-40fa-b0aa-d924b37e1e44 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:02.282872348 +0000 UTC m=+4.634078976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret") pod "global-pull-secret-syncer-6rktt" (UID: "1321b96a-f1b2-40fa-b0aa-d924b37e1e44") : object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.782987 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-run\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783029 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-run-ovn-kubernetes\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783076 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-var-lib-kubelet\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-conf-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783211 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783229 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-cnibin\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbzr4\" (UniqueName: \"kubernetes.io/projected/22d31356-96f2-41e3-a543-eb7c63146aef-kube-api-access-pbzr4\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783280 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-etc-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-k8s-cni-cncf-io\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-cni-bin\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783321 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-k8s-cni-cncf-io\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.784466 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-hostroot\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783350 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-kubelet\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-ovn\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783378 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/326372c5-d53f-4ff7-ad47-aa1dd50257d1-konnectivity-ca\") pod \"konnectivity-agent-cd9k8\" (UID: \"326372c5-d53f-4ff7-ad47-aa1dd50257d1\") " pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783421 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvgdq\" (UniqueName: \"kubernetes.io/projected/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-kube-api-access-fvgdq\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783444 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-var-lib-cni-bin\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783456 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vf9x\" (UniqueName: \"kubernetes.io/projected/274f5888-75df-49d0-9c3b-cd4dbb188489-kube-api-access-4vf9x\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783466 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-hostroot\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783491 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-kubelet\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysconfig\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783521 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-cni-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783526 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-ovn\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783557 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-socket-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783584 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-conf-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783647 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-cni-dir\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.785506 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783754 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-socket-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783827 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/326372c5-d53f-4ff7-ad47-aa1dd50257d1-agent-certs\") pod \"konnectivity-agent-cd9k8\" (UID: \"326372c5-d53f-4ff7-ad47-aa1dd50257d1\") " pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783969 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-sysconfig\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.783986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-systemd\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784014 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-etc-kubernetes\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-log-socket\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784072 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-systemd\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-lib-modules\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5288722d-1473-47cb-8cac-a629e5fed2a6-tmp\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784130 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-etc-kubernetes\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784146 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-slash\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-daemon-config\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784177 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-log-socket\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784190 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-multus-certs\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784207 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-slash\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:01.786276 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-device-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-cni-bin\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784285 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/274f5888-75df-49d0-9c3b-cd4dbb188489-host-slash\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784304 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-host\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdlgz\" (UniqueName: \"kubernetes.io/projected/5288722d-1473-47cb-8cac-a629e5fed2a6-kube-api-access-rdlgz\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784344 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-system-cni-dir\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784359 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-lib-modules\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784408 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-host-run-multus-certs\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.784469 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784472 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784489 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784364 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.784517 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs podName:0f735753-7333-48b5-9d5f-6f4dda9f29e1 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:02.284503087 +0000 UTC m=+4.635709733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs") pod "network-metrics-daemon-hbsxf" (UID: "0f735753-7333-48b5-9d5f-6f4dda9f29e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784548 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-host-cni-bin\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784561 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5288722d-1473-47cb-8cac-a629e5fed2a6-host\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784601 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22d31356-96f2-41e3-a543-eb7c63146aef-system-cni-dir\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.787144 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784761 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-systemd-units\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.787716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784839 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.787716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-multus-daemon-config\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.787716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784923 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-systemd-units\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.787716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784903 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe4903e3-8151-4d31-97a9-e51c2f97e867-run-openvswitch\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.787716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.784974 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-device-dir\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.787716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.785101 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22d31356-96f2-41e3-a543-eb7c63146aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.787716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.787440 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5288722d-1473-47cb-8cac-a629e5fed2a6-etc-tuned\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.787716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.787496 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5288722d-1473-47cb-8cac-a629e5fed2a6-tmp\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.788107 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.787731 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/326372c5-d53f-4ff7-ad47-aa1dd50257d1-agent-certs\") pod \"konnectivity-agent-cd9k8\" (UID: \"326372c5-d53f-4ff7-ad47-aa1dd50257d1\") " pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:01.790571 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.790546 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe4903e3-8151-4d31-97a9-e51c2f97e867-ovn-node-metrics-cert\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.794411 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.794386 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfmx2\" (UniqueName: \"kubernetes.io/projected/bb4fee55-9e36-4e8e-b7d5-82f0b73b035c-kube-api-access-jfmx2\") pod \"aws-ebs-csi-driver-node-cwsv8\" (UID: \"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.796188 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.796165 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pcch\" (UniqueName: \"kubernetes.io/projected/1d93b2fb-c3e3-4969-8805-8f3a7be1878d-kube-api-access-7pcch\") pod \"multus-wbvsn\" (UID: \"1d93b2fb-c3e3-4969-8805-8f3a7be1878d\") " pod="openshift-multus/multus-wbvsn" Sep 17 21:59:01.796423 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.796396 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgtfj\" (UniqueName: \"kubernetes.io/projected/fe4903e3-8151-4d31-97a9-e51c2f97e867-kube-api-access-rgtfj\") pod \"ovnkube-node-n26r9\" (UID: \"fe4903e3-8151-4d31-97a9-e51c2f97e867\") " pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:01.797324 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.796798 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdlgz\" (UniqueName: \"kubernetes.io/projected/5288722d-1473-47cb-8cac-a629e5fed2a6-kube-api-access-rdlgz\") pod \"tuned-b28sd\" (UID: \"5288722d-1473-47cb-8cac-a629e5fed2a6\") " pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.797769 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.797749 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbzr4\" (UniqueName: \"kubernetes.io/projected/22d31356-96f2-41e3-a543-eb7c63146aef-kube-api-access-pbzr4\") pod \"multus-additional-cni-plugins-s2n8p\" (UID: \"22d31356-96f2-41e3-a543-eb7c63146aef\") " pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:01.798645 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.798607 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9blk\" (UniqueName: \"kubernetes.io/projected/0f735753-7333-48b5-9d5f-6f4dda9f29e1-kube-api-access-w9blk\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:01.801745 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.801580 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 21:59:01.801745 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.801707 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bp8cv" Sep 17 21:59:01.810084 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.810063 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bp8cv" Sep 17 21:59:01.862372 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.862316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" event={"ID":"b52ba0411fe5bd8aeab626e963fd13fc","Type":"ContainerStarted","Data":"8e0edb1b05bb3c7460e857f15716cedaffa8f4aa9f50048a0ab54a5ae99cd28d"} Sep 17 21:59:01.863955 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.863923 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" event={"ID":"4c838c3bd5faca9499f3e40b6543bbed","Type":"ContainerStarted","Data":"c101d003bb4879edb686af8d8c10e9d1b6e21d3bde867dd221f8eaceb3516e04"} Sep 17 21:59:01.885321 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885291 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvgdq\" (UniqueName: \"kubernetes.io/projected/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-kube-api-access-fvgdq\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.885451 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vf9x\" (UniqueName: \"kubernetes.io/projected/274f5888-75df-49d0-9c3b-cd4dbb188489-kube-api-access-4vf9x\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.885451 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885384 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/274f5888-75df-49d0-9c3b-cd4dbb188489-host-slash\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.885565 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885448 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/274f5888-75df-49d0-9c3b-cd4dbb188489-host-slash\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.885629 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/274f5888-75df-49d0-9c3b-cd4dbb188489-iptables-alerter-script\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.885681 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-hosts-file\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.885730 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885688 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308aba24-dfd1-4096-8bb5-332d01c807c8-host\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.885730 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grjzt\" (UniqueName: \"kubernetes.io/projected/308aba24-dfd1-4096-8bb5-332d01c807c8-kube-api-access-grjzt\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.885825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885745 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:01.885825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/308aba24-dfd1-4096-8bb5-332d01c807c8-serviceca\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.885825 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.885816 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-tmp-dir\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.886137 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.886119 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-tmp-dir\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.886200 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.886180 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-hosts-file\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.886252 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.886238 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/308aba24-dfd1-4096-8bb5-332d01c807c8-host\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.886344 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.886312 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/274f5888-75df-49d0-9c3b-cd4dbb188489-iptables-alerter-script\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.886636 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.886614 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/308aba24-dfd1-4096-8bb5-332d01c807c8-serviceca\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.893056 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.893000 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 21:59:01.893056 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.893028 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 21:59:01.893056 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.893040 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgz4s for pod openshift-network-diagnostics/network-check-target-88wh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:01.893267 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:01.893113 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s podName:1289970f-e82e-447e-8eb4-760ee40dc1e2 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:02.393095559 +0000 UTC m=+4.744302192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kgz4s" (UniqueName: "kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s") pod "network-check-target-88wh9" (UID: "1289970f-e82e-447e-8eb4-760ee40dc1e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:01.894525 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.894501 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvgdq\" (UniqueName: \"kubernetes.io/projected/81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8-kube-api-access-fvgdq\") pod \"node-resolver-fm2vp\" (UID: \"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8\") " pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:01.895629 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.895607 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grjzt\" (UniqueName: \"kubernetes.io/projected/308aba24-dfd1-4096-8bb5-332d01c807c8-kube-api-access-grjzt\") pod \"node-ca-pvtjj\" (UID: \"308aba24-dfd1-4096-8bb5-332d01c807c8\") " pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:01.895724 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.895632 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vf9x\" (UniqueName: \"kubernetes.io/projected/274f5888-75df-49d0-9c3b-cd4dbb188489-kube-api-access-4vf9x\") pod \"iptables-alerter-kbz9w\" (UID: \"274f5888-75df-49d0-9c3b-cd4dbb188489\") " pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:01.968385 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.968353 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b28sd" Sep 17 21:59:01.977455 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.977429 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" Sep 17 21:59:01.988473 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:01.988440 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wbvsn" Sep 17 21:59:02.004994 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.004975 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" Sep 17 21:59:02.014602 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.014582 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:02.021285 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.021261 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:02.028863 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.028844 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pvtjj" Sep 17 21:59:02.037537 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.037518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fm2vp" Sep 17 21:59:02.046236 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.046217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kbz9w" Sep 17 21:59:02.288483 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.288399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:02.288483 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.288447 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:02.288693 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.288548 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:02.288693 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.288548 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:02.288693 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.288610 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs podName:0f735753-7333-48b5-9d5f-6f4dda9f29e1 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:03.288590242 +0000 UTC m=+5.639796864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs") pod "network-metrics-daemon-hbsxf" (UID: "0f735753-7333-48b5-9d5f-6f4dda9f29e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:02.288693 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.288629 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret podName:1321b96a-f1b2-40fa-b0aa-d924b37e1e44 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:03.288619989 +0000 UTC m=+5.639826612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret") pod "global-pull-secret-syncer-6rktt" (UID: "1321b96a-f1b2-40fa-b0aa-d924b37e1e44") : object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:02.489794 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.489748 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:02.490008 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.489897 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 21:59:02.490008 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.489938 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 21:59:02.490008 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.489949 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgz4s for pod openshift-network-diagnostics/network-check-target-88wh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:02.490150 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.490013 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s podName:1289970f-e82e-447e-8eb4-760ee40dc1e2 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:03.489995931 +0000 UTC m=+5.841202552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgz4s" (UniqueName: "kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s") pod "network-check-target-88wh9" (UID: "1289970f-e82e-447e-8eb4-760ee40dc1e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:02.814983 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.814946 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 21:54:01 +0000 UTC" deadline="2028-06-25 23:33:40.684015004 +0000 UTC" Sep 17 21:59:02.814983 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.814978 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15529h34m37.86904124s" Sep 17 21:59:02.857200 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.857162 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:02.857200 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:02.857183 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:02.857402 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.857293 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:02.857437 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:02.857415 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:02.889020 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.888991 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326372c5_d53f_4ff7_ad47_aa1dd50257d1.slice/crio-cfc5d47f6821d9f73107fa7fdfaba7efecf452bf9aadd45a9d753e403949b41a WatchSource:0}: Error finding container cfc5d47f6821d9f73107fa7fdfaba7efecf452bf9aadd45a9d753e403949b41a: Status 404 returned error can't find the container with id cfc5d47f6821d9f73107fa7fdfaba7efecf452bf9aadd45a9d753e403949b41a Sep 17 21:59:02.890073 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.890050 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5288722d_1473_47cb_8cac_a629e5fed2a6.slice/crio-542eadc83af4dafd722a8c0ea212e946a698c6b32e78c4ac746a1de12b15c0e9 WatchSource:0}: Error finding container 542eadc83af4dafd722a8c0ea212e946a698c6b32e78c4ac746a1de12b15c0e9: Status 404 returned error can't find the container with id 542eadc83af4dafd722a8c0ea212e946a698c6b32e78c4ac746a1de12b15c0e9 Sep 17 21:59:02.910327 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.910242 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d618d8_0b98_43b8_a9a5_fe3f73d8e4e8.slice/crio-006f52ad7223d28a23e9c0099662966f6efa44332aa63c0a2fb0c311ea83fd31 WatchSource:0}: Error finding container 006f52ad7223d28a23e9c0099662966f6efa44332aa63c0a2fb0c311ea83fd31: Status 404 returned error can't find the container with id 006f52ad7223d28a23e9c0099662966f6efa44332aa63c0a2fb0c311ea83fd31 Sep 17 21:59:02.911108 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.911080 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4903e3_8151_4d31_97a9_e51c2f97e867.slice/crio-bf64af086930fe87fdc4f4948ef0822e363db5d4fdeb3aabe9470ffd5efb05fc WatchSource:0}: Error finding container bf64af086930fe87fdc4f4948ef0822e363db5d4fdeb3aabe9470ffd5efb05fc: Status 404 returned error can't find the container with id bf64af086930fe87fdc4f4948ef0822e363db5d4fdeb3aabe9470ffd5efb05fc Sep 17 21:59:02.911781 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.911739 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274f5888_75df_49d0_9c3b_cd4dbb188489.slice/crio-9a2786d85ec938b04495c3e1c89153a6c2024f9283c9515b21fdca294ea124b4 WatchSource:0}: Error finding container 9a2786d85ec938b04495c3e1c89153a6c2024f9283c9515b21fdca294ea124b4: Status 404 returned error can't find the container with id 9a2786d85ec938b04495c3e1c89153a6c2024f9283c9515b21fdca294ea124b4 Sep 17 21:59:02.914637 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.914608 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d93b2fb_c3e3_4969_8805_8f3a7be1878d.slice/crio-31614dcbacd4b97155cb44755cfa412a3bab3cd63d110ffde0ac028e2535be0d WatchSource:0}: Error finding container 31614dcbacd4b97155cb44755cfa412a3bab3cd63d110ffde0ac028e2535be0d: Status 404 returned error can't find the container with id 31614dcbacd4b97155cb44755cfa412a3bab3cd63d110ffde0ac028e2535be0d Sep 17 21:59:02.916728 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.916577 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4fee55_9e36_4e8e_b7d5_82f0b73b035c.slice/crio-9236b79b610bae8e27bb5ac8e13798e6f0523553e793f58e932ed3c13d2ae600 WatchSource:0}: Error finding container 9236b79b610bae8e27bb5ac8e13798e6f0523553e793f58e932ed3c13d2ae600: Status 404 returned error can't find the container with id 9236b79b610bae8e27bb5ac8e13798e6f0523553e793f58e932ed3c13d2ae600 Sep 17 21:59:02.917523 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.917502 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308aba24_dfd1_4096_8bb5_332d01c807c8.slice/crio-9a294dc931c64fc207d7cf6fa0a45d19e581ecc9abe655895237b97f71544e63 WatchSource:0}: Error finding container 9a294dc931c64fc207d7cf6fa0a45d19e581ecc9abe655895237b97f71544e63: Status 404 returned error can't find the container with id 9a294dc931c64fc207d7cf6fa0a45d19e581ecc9abe655895237b97f71544e63 Sep 17 21:59:02.918743 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:02.918722 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d31356_96f2_41e3_a543_eb7c63146aef.slice/crio-47a0e4533b6a6697efeb368693133becef3e967526e1a59d9cc8d6d5275fec0d WatchSource:0}: Error finding container 47a0e4533b6a6697efeb368693133becef3e967526e1a59d9cc8d6d5275fec0d: Status 404 returned error can't find the container with id 47a0e4533b6a6697efeb368693133becef3e967526e1a59d9cc8d6d5275fec0d Sep 17 21:59:03.294730 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.294534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:03.294887 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.294763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:03.294887 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.294677 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:03.294887 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.294878 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:03.294887 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.294888 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret podName:1321b96a-f1b2-40fa-b0aa-d924b37e1e44 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:05.294870098 +0000 UTC m=+7.646076725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret") pod "global-pull-secret-syncer-6rktt" (UID: "1321b96a-f1b2-40fa-b0aa-d924b37e1e44") : object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:03.295103 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.294954 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs podName:0f735753-7333-48b5-9d5f-6f4dda9f29e1 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:05.294938997 +0000 UTC m=+7.646145623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs") pod "network-metrics-daemon-hbsxf" (UID: "0f735753-7333-48b5-9d5f-6f4dda9f29e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:03.497180 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.497092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:03.497347 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.497307 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 21:59:03.497347 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.497332 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 21:59:03.497347 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.497344 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgz4s for pod openshift-network-diagnostics/network-check-target-88wh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:03.497499 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.497404 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s podName:1289970f-e82e-447e-8eb4-760ee40dc1e2 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:05.497386855 +0000 UTC m=+7.848593479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgz4s" (UniqueName: "kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s") pod "network-check-target-88wh9" (UID: "1289970f-e82e-447e-8eb4-760ee40dc1e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:03.815705 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.815614 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 21:54:01 +0000 UTC" deadline="2028-06-07 09:10:38.834648896 +0000 UTC" Sep 17 21:59:03.815705 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.815659 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15083h11m35.018995092s" Sep 17 21:59:03.857883 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.857355 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:03.857883 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:03.857506 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:03.886717 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.886492 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" event={"ID":"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c","Type":"ContainerStarted","Data":"9236b79b610bae8e27bb5ac8e13798e6f0523553e793f58e932ed3c13d2ae600"} Sep 17 21:59:03.904094 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.904053 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbz9w" event={"ID":"274f5888-75df-49d0-9c3b-cd4dbb188489","Type":"ContainerStarted","Data":"9a2786d85ec938b04495c3e1c89153a6c2024f9283c9515b21fdca294ea124b4"} Sep 17 21:59:03.908867 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.908834 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"bf64af086930fe87fdc4f4948ef0822e363db5d4fdeb3aabe9470ffd5efb05fc"} Sep 17 21:59:03.927236 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.927190 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fm2vp" event={"ID":"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8","Type":"ContainerStarted","Data":"006f52ad7223d28a23e9c0099662966f6efa44332aa63c0a2fb0c311ea83fd31"} Sep 17 21:59:03.939718 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.939580 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wbvsn" event={"ID":"1d93b2fb-c3e3-4969-8805-8f3a7be1878d","Type":"ContainerStarted","Data":"31614dcbacd4b97155cb44755cfa412a3bab3cd63d110ffde0ac028e2535be0d"} Sep 17 21:59:03.951072 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.950999 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b28sd" event={"ID":"5288722d-1473-47cb-8cac-a629e5fed2a6","Type":"ContainerStarted","Data":"542eadc83af4dafd722a8c0ea212e946a698c6b32e78c4ac746a1de12b15c0e9"} Sep 17 21:59:03.956236 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.956164 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cd9k8" event={"ID":"326372c5-d53f-4ff7-ad47-aa1dd50257d1","Type":"ContainerStarted","Data":"cfc5d47f6821d9f73107fa7fdfaba7efecf452bf9aadd45a9d753e403949b41a"} Sep 17 21:59:03.976992 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.976644 2568 generic.go:356] "Generic (PLEG): container finished" podID="b52ba0411fe5bd8aeab626e963fd13fc" containerID="b8dfa89d1734ddcfdcd9a08575bdb1604fbbacab00e570f2e10bfb6ecc7fdb6a" exitCode=0 Sep 17 21:59:03.976992 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.976731 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" event={"ID":"b52ba0411fe5bd8aeab626e963fd13fc","Type":"ContainerDied","Data":"b8dfa89d1734ddcfdcd9a08575bdb1604fbbacab00e570f2e10bfb6ecc7fdb6a"} Sep 17 21:59:03.987616 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:03.987587 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" event={"ID":"4c838c3bd5faca9499f3e40b6543bbed","Type":"ContainerStarted","Data":"be74e602454abd908e4acb0d5342db4dd9de718dd2eba3bdf2a9ca80bac7ee9b"} Sep 17 21:59:04.006256 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:04.006204 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-200.ec2.internal" podStartSLOduration=4.006184206 podStartE2EDuration="4.006184206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:04.005313442 +0000 UTC m=+6.356520090" watchObservedRunningTime="2026-09-17 21:59:04.006184206 +0000 UTC m=+6.357390851" Sep 17 21:59:04.008247 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:04.008207 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerStarted","Data":"47a0e4533b6a6697efeb368693133becef3e967526e1a59d9cc8d6d5275fec0d"} Sep 17 21:59:04.018365 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:04.018315 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pvtjj" event={"ID":"308aba24-dfd1-4096-8bb5-332d01c807c8","Type":"ContainerStarted","Data":"9a294dc931c64fc207d7cf6fa0a45d19e581ecc9abe655895237b97f71544e63"} Sep 17 21:59:04.857678 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:04.856951 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:04.857678 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:04.857074 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:04.857678 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:04.857495 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:04.857678 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:04.857595 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:05.045068 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:05.044962 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" event={"ID":"b52ba0411fe5bd8aeab626e963fd13fc","Type":"ContainerStarted","Data":"b118c9c92ea3521eb07da4dbaa940710ab09b4e879e360a0410b06e63d472222"} Sep 17 21:59:05.313979 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:05.313871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:05.314130 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:05.314062 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:05.314324 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.314219 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:05.314324 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.314315 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs podName:0f735753-7333-48b5-9d5f-6f4dda9f29e1 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:09.314295372 +0000 UTC m=+11.665502013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs") pod "network-metrics-daemon-hbsxf" (UID: "0f735753-7333-48b5-9d5f-6f4dda9f29e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:05.314882 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.314721 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:05.314882 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.314775 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret podName:1321b96a-f1b2-40fa-b0aa-d924b37e1e44 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:09.31476051 +0000 UTC m=+11.665967136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret") pod "global-pull-secret-syncer-6rktt" (UID: "1321b96a-f1b2-40fa-b0aa-d924b37e1e44") : object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:05.514921 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:05.514856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:05.515170 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.515036 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 21:59:05.515170 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.515064 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 21:59:05.515170 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.515077 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgz4s for pod openshift-network-diagnostics/network-check-target-88wh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:05.515170 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.515148 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s podName:1289970f-e82e-447e-8eb4-760ee40dc1e2 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:09.515129969 +0000 UTC m=+11.866336606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgz4s" (UniqueName: "kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s") pod "network-check-target-88wh9" (UID: "1289970f-e82e-447e-8eb4-760ee40dc1e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:05.857530 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:05.857497 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:05.857729 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:05.857640 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:06.857146 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:06.857088 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:06.857330 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:06.857220 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:06.857631 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:06.857609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:06.857733 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:06.857716 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:07.857409 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:07.857370 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:07.857590 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:07.857500 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:08.858576 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:08.857723 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:08.858576 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:08.857861 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:08.858576 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:08.858354 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:08.858576 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:08.858470 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:09.351165 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:09.350323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:09.351165 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:09.350396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:09.351165 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.350549 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:09.351165 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.350620 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs podName:0f735753-7333-48b5-9d5f-6f4dda9f29e1 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:17.350597669 +0000 UTC m=+19.701804290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs") pod "network-metrics-daemon-hbsxf" (UID: "0f735753-7333-48b5-9d5f-6f4dda9f29e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:09.351165 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.351032 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:09.351165 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.351081 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret podName:1321b96a-f1b2-40fa-b0aa-d924b37e1e44 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:17.35106585 +0000 UTC m=+19.702272471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret") pod "global-pull-secret-syncer-6rktt" (UID: "1321b96a-f1b2-40fa-b0aa-d924b37e1e44") : object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:09.552246 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:09.552199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:09.552431 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.552396 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 21:59:09.552431 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.552417 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 21:59:09.552431 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.552430 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgz4s for pod openshift-network-diagnostics/network-check-target-88wh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:09.552589 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.552491 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s podName:1289970f-e82e-447e-8eb4-760ee40dc1e2 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:17.552472037 +0000 UTC m=+19.903678677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgz4s" (UniqueName: "kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s") pod "network-check-target-88wh9" (UID: "1289970f-e82e-447e-8eb4-760ee40dc1e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:09.858689 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:09.857418 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:09.858689 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:09.857552 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:10.856809 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:10.856778 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:10.857121 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:10.856894 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:10.862436 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:10.857234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:10.862436 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:10.857682 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:11.857577 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:11.857547 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:11.857772 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:11.857691 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:12.856890 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:12.856853 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:12.857337 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:12.856901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:12.857337 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:12.857024 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:12.857337 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:12.857158 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:13.856760 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:13.856724 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:13.856973 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:13.856852 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:14.857602 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:14.857561 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:14.858073 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:14.857561 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:14.858073 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:14.857695 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:14.858073 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:14.857832 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:15.857316 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:15.857275 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:15.857506 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:15.857428 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:16.857645 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:16.857615 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:16.858121 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:16.857658 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:16.858121 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:16.857747 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:16.858121 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:16.857840 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:17.409841 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:17.409807 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:17.410048 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:17.409872 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:17.410048 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.409986 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:17.410048 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.410000 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:17.410208 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.410062 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs podName:0f735753-7333-48b5-9d5f-6f4dda9f29e1 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:33.410044336 +0000 UTC m=+35.761250977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs") pod "network-metrics-daemon-hbsxf" (UID: "0f735753-7333-48b5-9d5f-6f4dda9f29e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:17.410208 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.410078 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret podName:1321b96a-f1b2-40fa-b0aa-d924b37e1e44 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:33.410070782 +0000 UTC m=+35.761277404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret") pod "global-pull-secret-syncer-6rktt" (UID: "1321b96a-f1b2-40fa-b0aa-d924b37e1e44") : object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:17.611383 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:17.611337 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:17.611590 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.611508 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 21:59:17.611590 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.611525 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 21:59:17.611590 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.611537 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgz4s for pod openshift-network-diagnostics/network-check-target-88wh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:17.611704 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.611596 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s podName:1289970f-e82e-447e-8eb4-760ee40dc1e2 nodeName:}" failed. No retries permitted until 2026-09-17 21:59:33.611578957 +0000 UTC m=+35.962785579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgz4s" (UniqueName: "kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s") pod "network-check-target-88wh9" (UID: "1289970f-e82e-447e-8eb4-760ee40dc1e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:17.857228 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:17.857157 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:17.857389 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:17.857290 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:18.857341 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:18.857299 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:18.857816 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:18.857300 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:18.857816 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:18.857433 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:18.857816 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:18.857522 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:19.857923 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:19.857886 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:19.858322 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:19.858008 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:20.857749 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:20.857601 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:20.857852 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:20.857660 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:20.857852 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:20.857823 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:20.857949 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:20.857890 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:21.078445 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.078415 2568 generic.go:356] "Generic (PLEG): container finished" podID="22d31356-96f2-41e3-a543-eb7c63146aef" containerID="6c2ac7cf8adceeb7c135cce4b6bc8615f1146de3a850b66b35666552b297ea93" exitCode=0 Sep 17 21:59:21.078570 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.078500 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerDied","Data":"6c2ac7cf8adceeb7c135cce4b6bc8615f1146de3a850b66b35666552b297ea93"} Sep 17 21:59:21.080204 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.080179 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pvtjj" event={"ID":"308aba24-dfd1-4096-8bb5-332d01c807c8","Type":"ContainerStarted","Data":"3aba2728a59a00220bb81de5a711eb0153f0a472f4b688f0ba7eb1e196fe0255"} Sep 17 21:59:21.081811 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.081791 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" event={"ID":"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c","Type":"ContainerStarted","Data":"59c1dd4369530754fa57e5a2fdbaff291fa88234444f1525fe25e5910a75c2b6"} Sep 17 21:59:21.084516 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.084497 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 21:59:21.085019 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.084996 2568 generic.go:356] "Generic (PLEG): container finished" podID="fe4903e3-8151-4d31-97a9-e51c2f97e867" containerID="440cacf5fdaf655b44e00e30932cc05a3e374601eb9db88f5a97eafa92ae6d17" exitCode=1 Sep 17 21:59:21.085140 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.085067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"4d5703167ddfa2c7c08991793666bf91f242120489dda72fab6870367df2ae2d"} Sep 17 21:59:21.085140 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.085135 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"3b7f53c330f69fcdaeff1705358c24f0c928f12d34b710caa64ae15414314cd4"} Sep 17 21:59:21.085243 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.085186 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerDied","Data":"440cacf5fdaf655b44e00e30932cc05a3e374601eb9db88f5a97eafa92ae6d17"} Sep 17 21:59:21.085243 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.085237 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"42273a004a427d4706e445c98efadd8fc30d73dd842c41cc8e22f72c41def513"} Sep 17 21:59:21.087090 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.087064 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fm2vp" event={"ID":"81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8","Type":"ContainerStarted","Data":"6d5ab1c9538eb71c5c064c0aa3b7a59acf5b91bf713f714aa98d04bf25f05173"} Sep 17 21:59:21.089932 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.089888 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wbvsn" event={"ID":"1d93b2fb-c3e3-4969-8805-8f3a7be1878d","Type":"ContainerStarted","Data":"0cd9b87dbbc132eabf9b98250e9b414ef262aceca3b487c4f905d54401677135"} Sep 17 21:59:21.095292 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.094845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b28sd" event={"ID":"5288722d-1473-47cb-8cac-a629e5fed2a6","Type":"ContainerStarted","Data":"b88d28b26237eb9b10f4da6740e36e92601ef4b653cff20f0e651a0410a5b024"} Sep 17 21:59:21.097346 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.097323 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cd9k8" event={"ID":"326372c5-d53f-4ff7-ad47-aa1dd50257d1","Type":"ContainerStarted","Data":"2728ee8b82b9b088e3b5bf27b33eaca61d5f3a4415b9f36117462dcbcb56bf69"} Sep 17 21:59:21.105208 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.105166 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-200.ec2.internal" podStartSLOduration=21.105153943 podStartE2EDuration="21.105153943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:05.061967731 +0000 UTC m=+7.413174373" watchObservedRunningTime="2026-09-17 21:59:21.105153943 +0000 UTC m=+23.456360588" Sep 17 21:59:21.125159 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.125108 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pvtjj" podStartSLOduration=3.5804274400000002 podStartE2EDuration="21.125086927s" totalImagesPullingTime="17.544659487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:21.124527375 +0000 UTC m=+23.475734020" watchObservedRunningTime="2026-09-17 21:59:21.125086927 +0000 UTC m=+23.476293582" Sep 17 21:59:21.147309 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.147258 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b28sd" podStartSLOduration=4.503322773 podStartE2EDuration="22.147238878s" totalImagesPullingTime="17.643916105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:21.147086532 +0000 UTC m=+23.498293177" watchObservedRunningTime="2026-09-17 21:59:21.147238878 +0000 UTC m=+23.498445516" Sep 17 21:59:21.186828 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.186782 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cd9k8" podStartSLOduration=7.044527618 podStartE2EDuration="21.186766416s" totalImagesPullingTime="14.142238798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:21.169418701 +0000 UTC m=+23.520625344" watchObservedRunningTime="2026-09-17 21:59:21.186766416 +0000 UTC m=+23.537973059" Sep 17 21:59:21.197587 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.197569 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pvtjj_308aba24-dfd1-4096-8bb5-332d01c807c8/node-ca/0.log" Sep 17 21:59:21.221401 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.221304 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wbvsn" podStartSLOduration=4.604766001 podStartE2EDuration="22.221289582s" totalImagesPullingTime="17.616523581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:21.221137849 +0000 UTC m=+23.572344496" watchObservedRunningTime="2026-09-17 21:59:21.221289582 +0000 UTC m=+23.572496225" Sep 17 21:59:21.221647 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.221617 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fm2vp" podStartSLOduration=3.670091433 podStartE2EDuration="21.221608195s" totalImagesPullingTime="17.551516762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:21.186411114 +0000 UTC m=+23.537617759" watchObservedRunningTime="2026-09-17 21:59:21.221608195 +0000 UTC m=+23.572814899" Sep 17 21:59:21.856794 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.856760 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:21.856963 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:21.856931 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:21.914337 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:21.914293 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 21:59:22.101900 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.101809 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" event={"ID":"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c","Type":"ContainerStarted","Data":"e8830d4a4e5df9800fc357c486c1b5e7ddfcb1228189518727538539d0f259b0"} Sep 17 21:59:22.103709 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.103680 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kbz9w" event={"ID":"274f5888-75df-49d0-9c3b-cd4dbb188489","Type":"ContainerStarted","Data":"e021869c3fb7fefdf91611c2d8b3d780cc2c4f47dace1698a7a937796960e485"} Sep 17 21:59:22.107594 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.107572 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 21:59:22.108091 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.108048 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"1325dee9c03a71883c356ef64f9121eb3a571a08ba1b30115f25a9c92584244a"} Sep 17 21:59:22.108209 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.108144 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"12efa1bd008f1864d5274539917e1d73bfa93d8c10129cd5c18e60f8475bb9bf"} Sep 17 21:59:22.123315 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.123258 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kbz9w" podStartSLOduration=4.580793989 podStartE2EDuration="22.123236077s" totalImagesPullingTime="17.542442088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:22.123166027 +0000 UTC m=+24.474372684" watchObservedRunningTime="2026-09-17 21:59:22.123236077 +0000 UTC m=+24.474442723" Sep 17 21:59:22.752669 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.752559 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T21:59:21.914309996Z","UUID":"5546b011-54c2-43ff-92d2-8b7983ab22f4","Handler":null,"Name":"","Endpoint":""} Sep 17 21:59:22.754288 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.754264 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 21:59:22.754410 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.754302 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 21:59:22.856899 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.856872 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:22.857106 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:22.857014 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:22.857106 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:22.857062 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:22.857231 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:22.857152 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:23.113524 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:23.113490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" event={"ID":"bb4fee55-9e36-4e8e-b7d5-82f0b73b035c","Type":"ContainerStarted","Data":"eb00065e71c0add86edeba6ccda09a48be41e9d6a4650f5badfb4bde4b4a3aab"} Sep 17 21:59:23.133811 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:23.133749 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cwsv8" podStartSLOduration=4.48825097 podStartE2EDuration="24.133727294s" totalImagesPullingTime="19.645476324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:58:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:23.133509722 +0000 UTC m=+25.484716367" watchObservedRunningTime="2026-09-17 21:59:23.133727294 +0000 UTC m=+25.484933940" Sep 17 21:59:23.857385 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:23.857363 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:23.857540 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:23.857464 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:24.120099 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:24.119823 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 21:59:24.120770 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:24.120740 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"cd67ef21de824090eb9d535bfb46e895faab63a2f1869140f1f7cc26c1c6e48c"} Sep 17 21:59:24.563240 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:24.563204 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:24.567850 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:24.567820 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:24.856865 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:24.856776 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:24.856865 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:24.856832 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:24.857132 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:24.856902 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:24.857132 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:24.857029 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:25.123281 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:25.123194 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:25.123771 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:25.123682 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cd9k8" Sep 17 21:59:25.857533 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:25.857498 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:25.857698 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:25.857614 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:26.129000 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.128925 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 21:59:26.129787 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.129350 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"86be63b3a956c1b6a1087e06d014efe7804b6be16e94888db23f8d9241e9498b"} Sep 17 21:59:26.129787 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.129685 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:26.129896 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.129829 2568 scope.go:117] "RemoveContainer" containerID="440cacf5fdaf655b44e00e30932cc05a3e374601eb9db88f5a97eafa92ae6d17" Sep 17 21:59:26.129896 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.129852 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:26.130042 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.129949 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:26.131585 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.131561 2568 generic.go:356] "Generic (PLEG): container finished" podID="22d31356-96f2-41e3-a543-eb7c63146aef" containerID="184dbb012090051a97bc40925cefaf338f1d56bf00fd8deac61ac854cedc3414" exitCode=0 Sep 17 21:59:26.131689 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.131642 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerDied","Data":"184dbb012090051a97bc40925cefaf338f1d56bf00fd8deac61ac854cedc3414"} Sep 17 21:59:26.148367 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.148342 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:26.148583 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.148566 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:26.857347 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.857308 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:26.857347 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:26.857349 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:26.857527 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:26.857428 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:26.857527 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:26.857502 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:27.137522 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:27.137448 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 21:59:27.137928 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:27.137794 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" event={"ID":"fe4903e3-8151-4d31-97a9-e51c2f97e867","Type":"ContainerStarted","Data":"552aa4007abc8052ab38351250697d4ae4f5131b58b37fcdc025f3891175c815"} Sep 17 21:59:27.170199 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:27.170138 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" podStartSLOduration=9.480379162 podStartE2EDuration="27.170121218s" totalImagesPullingTime="17.689742056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:27.169126493 +0000 UTC m=+29.520333138" watchObservedRunningTime="2026-09-17 21:59:27.170121218 +0000 UTC m=+29.521327859" Sep 17 21:59:27.856735 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:27.856695 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:27.856958 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:27.856845 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:28.142346 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:28.142262 2568 generic.go:356] "Generic (PLEG): container finished" podID="22d31356-96f2-41e3-a543-eb7c63146aef" containerID="98b758c16259334a1a2abfc90b8135bdeb80a79bdd97ccf19b770ea30c4647c0" exitCode=0 Sep 17 21:59:28.142346 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:28.142337 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerDied","Data":"98b758c16259334a1a2abfc90b8135bdeb80a79bdd97ccf19b770ea30c4647c0"} Sep 17 21:59:28.856666 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:28.856626 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:28.856847 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:28.856686 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:28.856847 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:28.856767 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:28.856977 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:28.856937 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:29.858385 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:29.858354 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:29.858794 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:29.858442 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:30.148511 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:30.148432 2568 generic.go:356] "Generic (PLEG): container finished" podID="22d31356-96f2-41e3-a543-eb7c63146aef" containerID="0e0cfb0f733b1a6bf58efb9decdc85c57afd095d06b6b419a7498e49b04eb576" exitCode=0 Sep 17 21:59:30.148511 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:30.148467 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerDied","Data":"0e0cfb0f733b1a6bf58efb9decdc85c57afd095d06b6b419a7498e49b04eb576"} Sep 17 21:59:30.857274 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:30.857238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:30.857455 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:30.857238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:30.857455 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:30.857372 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:30.857455 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:30.857446 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:31.856702 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:31.856669 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:31.857225 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:31.856788 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:32.856979 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:32.856941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:32.857457 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:32.856946 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:32.857457 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:32.857082 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:32.857457 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:32.857148 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:33.432874 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:33.432833 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:33.433174 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:33.432891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:33.433174 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.433010 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:33.433174 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.433008 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:33.433174 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.433075 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret podName:1321b96a-f1b2-40fa-b0aa-d924b37e1e44 nodeName:}" failed. No retries permitted until 2026-09-17 22:00:05.433056701 +0000 UTC m=+67.784263323 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret") pod "global-pull-secret-syncer-6rktt" (UID: "1321b96a-f1b2-40fa-b0aa-d924b37e1e44") : object "kube-system"/"original-pull-secret" not registered Sep 17 21:59:33.433174 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.433097 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs podName:0f735753-7333-48b5-9d5f-6f4dda9f29e1 nodeName:}" failed. No retries permitted until 2026-09-17 22:00:05.43308632 +0000 UTC m=+67.784292944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs") pod "network-metrics-daemon-hbsxf" (UID: "0f735753-7333-48b5-9d5f-6f4dda9f29e1") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 21:59:33.634483 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:33.634444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:33.634677 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.634632 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 21:59:33.634677 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.634658 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 21:59:33.634677 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.634670 2568 projected.go:196] Error preparing data for projected volume kube-api-access-kgz4s for pod openshift-network-diagnostics/network-check-target-88wh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:33.634838 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.634739 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s podName:1289970f-e82e-447e-8eb4-760ee40dc1e2 nodeName:}" failed. No retries permitted until 2026-09-17 22:00:05.634716925 +0000 UTC m=+67.985923567 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgz4s" (UniqueName: "kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s") pod "network-check-target-88wh9" (UID: "1289970f-e82e-447e-8eb4-760ee40dc1e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 21:59:33.857464 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:33.857429 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:33.857876 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:33.857590 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:34.857534 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:34.857499 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:34.857938 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:34.857504 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:34.857938 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:34.857599 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:34.857938 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:34.857678 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:35.164407 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:35.164364 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerStarted","Data":"3bec75aebd622b9be69aa774e7fb12a0171dfb246b0f3afa34c3635ef6a95ed4"} Sep 17 21:59:35.857002 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:35.856969 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:35.857200 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:35.857097 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:36.169203 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:36.169121 2568 generic.go:356] "Generic (PLEG): container finished" podID="22d31356-96f2-41e3-a543-eb7c63146aef" containerID="3bec75aebd622b9be69aa774e7fb12a0171dfb246b0f3afa34c3635ef6a95ed4" exitCode=0 Sep 17 21:59:36.169203 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:36.169192 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerDied","Data":"3bec75aebd622b9be69aa774e7fb12a0171dfb246b0f3afa34c3635ef6a95ed4"} Sep 17 21:59:36.857426 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:36.857247 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:36.857602 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:36.857502 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:36.857602 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:36.857320 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:36.857689 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:36.857613 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:37.174966 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:37.174862 2568 generic.go:356] "Generic (PLEG): container finished" podID="22d31356-96f2-41e3-a543-eb7c63146aef" containerID="c5933bb92ccd0826f4297671617ecf7917e79c66d491af06d88d0278f30ceb28" exitCode=0 Sep 17 21:59:37.174966 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:37.174950 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerDied","Data":"c5933bb92ccd0826f4297671617ecf7917e79c66d491af06d88d0278f30ceb28"} Sep 17 21:59:37.857169 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:37.857128 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:37.857375 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:37.857265 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:38.180532 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:38.180447 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" event={"ID":"22d31356-96f2-41e3-a543-eb7c63146aef","Type":"ContainerStarted","Data":"394f0b20fba1bc5ab613cb2f90524c5b06dd647cd6e56d6546bf2f40549938ad"} Sep 17 21:59:38.221687 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:38.221633 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s2n8p" podStartSLOduration=10.235262932 podStartE2EDuration="39.22161641s" totalImagesPullingTime="28.986353478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:58:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:38.221145841 +0000 UTC m=+40.572352485" watchObservedRunningTime="2026-09-17 21:59:38.22161641 +0000 UTC m=+40.572823053" Sep 17 21:59:38.856972 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:38.856935 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:38.857159 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:38.856935 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:38.857159 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:38.857042 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:38.857159 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:38.857107 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:39.858166 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:39.858128 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:39.858564 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:39.858220 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:40.857069 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:40.857033 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:40.857361 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:40.857137 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:40.857361 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:40.857187 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:40.857361 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:40.857274 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:41.563706 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:41.563662 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rktt"] Sep 17 21:59:41.564548 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:41.563836 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:41.564548 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:41.563975 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:41.566087 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:41.566036 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-88wh9"] Sep 17 21:59:41.566191 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:41.566138 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:41.566251 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:41.566232 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:41.567467 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:41.567444 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hbsxf"] Sep 17 21:59:41.567580 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:41.567550 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:41.567675 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:41.567651 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:42.856744 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:42.856703 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:42.857322 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:42.856715 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:42.857322 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:42.856832 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:42.857322 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:42.856889 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:43.857278 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:43.857241 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:43.857662 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:43.857348 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rktt" podUID="1321b96a-f1b2-40fa-b0aa-d924b37e1e44" Sep 17 21:59:44.857453 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:44.857413 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:44.857828 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:44.857420 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:44.857828 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:44.857521 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-88wh9" podUID="1289970f-e82e-447e-8eb4-760ee40dc1e2" Sep 17 21:59:44.857828 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:44.857598 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hbsxf" podUID="0f735753-7333-48b5-9d5f-6f4dda9f29e1" Sep 17 21:59:45.403990 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.403965 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-200.ec2.internal" event="NodeReady" Sep 17 21:59:45.404178 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.404097 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 21:59:45.450852 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.450817 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m4lk9"] Sep 17 21:59:45.464447 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.464421 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gmgh8"] Sep 17 21:59:45.464605 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.464518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m4lk9" Sep 17 21:59:45.467234 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.467211 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 21:59:45.467636 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.467570 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4j597\"" Sep 17 21:59:45.468069 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.467894 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 21:59:45.468069 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.467978 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 21:59:45.488368 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.488340 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m4lk9"] Sep 17 21:59:45.488368 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.488369 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gmgh8"] Sep 17 21:59:45.488511 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.488403 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.491114 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.491094 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 21:59:45.491250 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.491165 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 21:59:45.491250 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.491217 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g6j2k\"" Sep 17 21:59:45.491397 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.491378 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 21:59:45.491546 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.491531 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 21:59:45.561074 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.560993 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bq5ht"] Sep 17 21:59:45.582470 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.582441 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bq5ht"] Sep 17 21:59:45.582615 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.582555 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.585558 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.585535 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 21:59:45.585713 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.585538 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 21:59:45.585713 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.585544 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mg4m2\"" Sep 17 21:59:45.614897 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.614861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sv4f\" (UniqueName: \"kubernetes.io/projected/15ea6a3f-16d5-412e-8426-5ad259951ef8-kube-api-access-9sv4f\") pod \"ingress-canary-m4lk9\" (UID: \"15ea6a3f-16d5-412e-8426-5ad259951ef8\") " pod="openshift-ingress-canary/ingress-canary-m4lk9" Sep 17 21:59:45.614897 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.614893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15ea6a3f-16d5-412e-8426-5ad259951ef8-cert\") pod \"ingress-canary-m4lk9\" (UID: \"15ea6a3f-16d5-412e-8426-5ad259951ef8\") " pod="openshift-ingress-canary/ingress-canary-m4lk9" Sep 17 21:59:45.615119 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.614960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d43f1aa3-a870-4010-8bfe-405778c29440-crio-socket\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.615119 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.614979 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d43f1aa3-a870-4010-8bfe-405778c29440-data-volume\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.615119 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.614994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d43f1aa3-a870-4010-8bfe-405778c29440-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.615119 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.615010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d43f1aa3-a870-4010-8bfe-405778c29440-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.615119 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.615077 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tndx\" (UniqueName: \"kubernetes.io/projected/d43f1aa3-a870-4010-8bfe-405778c29440-kube-api-access-5tndx\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.716223 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716190 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a09779a6-cc7c-4067-89e2-b8c34304ce17-metrics-tls\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.716368 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsps\" (UniqueName: \"kubernetes.io/projected/a09779a6-cc7c-4067-89e2-b8c34304ce17-kube-api-access-6wsps\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.716368 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sv4f\" (UniqueName: \"kubernetes.io/projected/15ea6a3f-16d5-412e-8426-5ad259951ef8-kube-api-access-9sv4f\") pod \"ingress-canary-m4lk9\" (UID: \"15ea6a3f-16d5-412e-8426-5ad259951ef8\") " pod="openshift-ingress-canary/ingress-canary-m4lk9" Sep 17 21:59:45.716368 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15ea6a3f-16d5-412e-8426-5ad259951ef8-cert\") pod \"ingress-canary-m4lk9\" (UID: \"15ea6a3f-16d5-412e-8426-5ad259951ef8\") " pod="openshift-ingress-canary/ingress-canary-m4lk9" Sep 17 21:59:45.716526 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716393 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a09779a6-cc7c-4067-89e2-b8c34304ce17-tmp-dir\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.716526 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d43f1aa3-a870-4010-8bfe-405778c29440-crio-socket\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.716526 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716464 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d43f1aa3-a870-4010-8bfe-405778c29440-data-volume\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.716526 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d43f1aa3-a870-4010-8bfe-405778c29440-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.716526 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716518 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d43f1aa3-a870-4010-8bfe-405778c29440-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.716726 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716620 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tndx\" (UniqueName: \"kubernetes.io/projected/d43f1aa3-a870-4010-8bfe-405778c29440-kube-api-access-5tndx\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.716726 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716625 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d43f1aa3-a870-4010-8bfe-405778c29440-crio-socket\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.717021 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a09779a6-cc7c-4067-89e2-b8c34304ce17-config-volume\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.717075 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.716957 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d43f1aa3-a870-4010-8bfe-405778c29440-data-volume\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.717190 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.717166 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d43f1aa3-a870-4010-8bfe-405778c29440-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.720829 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.720805 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d43f1aa3-a870-4010-8bfe-405778c29440-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.720954 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.720862 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15ea6a3f-16d5-412e-8426-5ad259951ef8-cert\") pod \"ingress-canary-m4lk9\" (UID: \"15ea6a3f-16d5-412e-8426-5ad259951ef8\") " pod="openshift-ingress-canary/ingress-canary-m4lk9" Sep 17 21:59:45.726783 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.726761 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tndx\" (UniqueName: \"kubernetes.io/projected/d43f1aa3-a870-4010-8bfe-405778c29440-kube-api-access-5tndx\") pod \"insights-runtime-extractor-gmgh8\" (UID: \"d43f1aa3-a870-4010-8bfe-405778c29440\") " pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.727034 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.727018 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sv4f\" (UniqueName: \"kubernetes.io/projected/15ea6a3f-16d5-412e-8426-5ad259951ef8-kube-api-access-9sv4f\") pod \"ingress-canary-m4lk9\" (UID: \"15ea6a3f-16d5-412e-8426-5ad259951ef8\") " pod="openshift-ingress-canary/ingress-canary-m4lk9" Sep 17 21:59:45.774924 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.774883 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m4lk9" Sep 17 21:59:45.796123 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.796094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gmgh8" Sep 17 21:59:45.817646 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.817621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a09779a6-cc7c-4067-89e2-b8c34304ce17-config-volume\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.817779 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.817651 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a09779a6-cc7c-4067-89e2-b8c34304ce17-metrics-tls\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.817779 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.817669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsps\" (UniqueName: \"kubernetes.io/projected/a09779a6-cc7c-4067-89e2-b8c34304ce17-kube-api-access-6wsps\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.817779 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.817704 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a09779a6-cc7c-4067-89e2-b8c34304ce17-tmp-dir\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.818508 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.818064 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a09779a6-cc7c-4067-89e2-b8c34304ce17-tmp-dir\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.818508 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.818410 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a09779a6-cc7c-4067-89e2-b8c34304ce17-config-volume\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.820648 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.820622 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a09779a6-cc7c-4067-89e2-b8c34304ce17-metrics-tls\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.828642 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.828621 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsps\" (UniqueName: \"kubernetes.io/projected/a09779a6-cc7c-4067-89e2-b8c34304ce17-kube-api-access-6wsps\") pod \"dns-default-bq5ht\" (UID: \"a09779a6-cc7c-4067-89e2-b8c34304ce17\") " pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:45.858177 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.858144 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 21:59:45.862319 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.862291 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 21:59:45.891814 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:45.891524 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:46.126814 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.126640 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m4lk9"] Sep 17 21:59:46.128181 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.128155 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gmgh8"] Sep 17 21:59:46.131172 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:46.131147 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ea6a3f_16d5_412e_8426_5ad259951ef8.slice/crio-a83a694847219ef6738ce059870edf26c97b37631b3e5726ac093b3c1097c6e7 WatchSource:0}: Error finding container a83a694847219ef6738ce059870edf26c97b37631b3e5726ac093b3c1097c6e7: Status 404 returned error can't find the container with id a83a694847219ef6738ce059870edf26c97b37631b3e5726ac093b3c1097c6e7 Sep 17 21:59:46.132142 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:46.132113 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43f1aa3_a870_4010_8bfe_405778c29440.slice/crio-d69eeb549208562b608d2cda9d6336694a382ea28abbae1fadca36939834365f WatchSource:0}: Error finding container d69eeb549208562b608d2cda9d6336694a382ea28abbae1fadca36939834365f: Status 404 returned error can't find the container with id d69eeb549208562b608d2cda9d6336694a382ea28abbae1fadca36939834365f Sep 17 21:59:46.192636 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.192614 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bq5ht"] Sep 17 21:59:46.199106 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.199065 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmgh8" event={"ID":"d43f1aa3-a870-4010-8bfe-405778c29440","Type":"ContainerStarted","Data":"d69eeb549208562b608d2cda9d6336694a382ea28abbae1fadca36939834365f"} Sep 17 21:59:46.200177 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.200155 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m4lk9" event={"ID":"15ea6a3f-16d5-412e-8426-5ad259951ef8","Type":"ContainerStarted","Data":"a83a694847219ef6738ce059870edf26c97b37631b3e5726ac093b3c1097c6e7"} Sep 17 21:59:46.205056 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:46.205032 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09779a6_cc7c_4067_89e2_b8c34304ce17.slice/crio-d44c99435fd420f49e0af2d24f912f4a17a791f5ac07640d212de02f2b3c8c26 WatchSource:0}: Error finding container d44c99435fd420f49e0af2d24f912f4a17a791f5ac07640d212de02f2b3c8c26: Status 404 returned error can't find the container with id d44c99435fd420f49e0af2d24f912f4a17a791f5ac07640d212de02f2b3c8c26 Sep 17 21:59:46.835501 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.835466 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74"] Sep 17 21:59:46.857596 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.857562 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74"] Sep 17 21:59:46.857760 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.857705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 21:59:46.858157 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.858139 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" Sep 17 21:59:46.858404 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.858382 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 21:59:46.861834 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.861813 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 21:59:46.861970 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.861864 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ks7q\"" Sep 17 21:59:46.862045 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.861813 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q7xxp\"" Sep 17 21:59:46.862105 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.862044 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hhdb6\"" Sep 17 21:59:46.862206 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.862187 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 21:59:46.862264 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.862243 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 21:59:46.862403 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:46.862389 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 21:59:47.027776 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:47.027729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/80ed96cf-0293-408d-806d-91269c0b352a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6fx74\" (UID: \"80ed96cf-0293-408d-806d-91269c0b352a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" Sep 17 21:59:47.128862 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:47.128826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/80ed96cf-0293-408d-806d-91269c0b352a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6fx74\" (UID: \"80ed96cf-0293-408d-806d-91269c0b352a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" Sep 17 21:59:47.129063 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:47.129041 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 21:59:47.129177 ip-10-0-133-200 kubenswrapper[2568]: E0917 21:59:47.129110 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ed96cf-0293-408d-806d-91269c0b352a-tls-certificates podName:80ed96cf-0293-408d-806d-91269c0b352a nodeName:}" failed. No retries permitted until 2026-09-17 21:59:47.629089801 +0000 UTC m=+49.980296423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/80ed96cf-0293-408d-806d-91269c0b352a-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-6fx74" (UID: "80ed96cf-0293-408d-806d-91269c0b352a") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 21:59:47.205545 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:47.205506 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmgh8" event={"ID":"d43f1aa3-a870-4010-8bfe-405778c29440","Type":"ContainerStarted","Data":"dd1b0bc52c60f14efbc0d2917ea4adaf0de2b3ba2ae009e40cf79e1c55ecdeba"} Sep 17 21:59:47.205726 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:47.205590 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmgh8" event={"ID":"d43f1aa3-a870-4010-8bfe-405778c29440","Type":"ContainerStarted","Data":"24688ac1e9cceb945fea0408d8636bdac3f8388ba7266018f30f1ac7f0ba3a4e"} Sep 17 21:59:47.207244 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:47.207211 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq5ht" event={"ID":"a09779a6-cc7c-4067-89e2-b8c34304ce17","Type":"ContainerStarted","Data":"d44c99435fd420f49e0af2d24f912f4a17a791f5ac07640d212de02f2b3c8c26"} Sep 17 21:59:47.632025 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:47.631981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/80ed96cf-0293-408d-806d-91269c0b352a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6fx74\" (UID: \"80ed96cf-0293-408d-806d-91269c0b352a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" Sep 17 21:59:47.635860 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:47.635837 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/80ed96cf-0293-408d-806d-91269c0b352a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-6fx74\" (UID: \"80ed96cf-0293-408d-806d-91269c0b352a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" Sep 17 21:59:47.785640 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:47.785604 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" Sep 17 21:59:48.960397 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.960367 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-985dbf6b7-dsmhs"] Sep 17 21:59:48.970283 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.970263 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:48.973701 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.973642 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-985dbf6b7-dsmhs"] Sep 17 21:59:48.973876 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.973857 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 21:59:48.974265 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.974154 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 21:59:48.974265 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.974189 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 21:59:48.974265 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.974220 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qjgsp\"" Sep 17 21:59:48.974265 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.974256 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 21:59:48.974544 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.974408 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 21:59:48.974845 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.974827 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 21:59:48.974933 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.974829 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 21:59:48.979122 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:48.979097 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 21:59:49.142354 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.142318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-console-config\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.142354 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.142349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-oauth-serving-cert\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.142600 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.142368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg6zz\" (UniqueName: \"kubernetes.io/projected/92a73798-b21a-4884-b5bc-e215a1caeea3-kube-api-access-wg6zz\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.142600 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.142447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-oauth-config\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.142600 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.142470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-service-ca\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.142600 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.142489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-trusted-ca-bundle\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.142600 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.142511 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-serving-cert\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.243867 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.243789 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-console-config\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.243867 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.243824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-oauth-serving-cert\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.243867 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.243846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg6zz\" (UniqueName: \"kubernetes.io/projected/92a73798-b21a-4884-b5bc-e215a1caeea3-kube-api-access-wg6zz\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.244158 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.243934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-oauth-config\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.244158 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.243957 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-service-ca\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.244158 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.243988 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-trusted-ca-bundle\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.244158 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.244022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-serving-cert\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.244671 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.244640 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-console-config\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.244813 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.244790 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-oauth-serving-cert\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.244897 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.244850 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-service-ca\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.245358 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.245333 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-trusted-ca-bundle\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.247114 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.247065 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-oauth-config\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.247216 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.247160 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-serving-cert\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.252550 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.252527 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg6zz\" (UniqueName: \"kubernetes.io/projected/92a73798-b21a-4884-b5bc-e215a1caeea3-kube-api-access-wg6zz\") pod \"console-985dbf6b7-dsmhs\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:49.281527 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:49.281497 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:50.219842 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:50.219646 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74"] Sep 17 21:59:50.225204 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:50.225032 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-985dbf6b7-dsmhs"] Sep 17 21:59:50.225204 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:50.225163 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gmgh8" event={"ID":"d43f1aa3-a870-4010-8bfe-405778c29440","Type":"ContainerStarted","Data":"35d6a1f54f3b0dd49071daab1d70c5e86e82e7bd48e134bac6fcee119ef02a48"} Sep 17 21:59:50.227646 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:50.227595 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m4lk9" event={"ID":"15ea6a3f-16d5-412e-8426-5ad259951ef8","Type":"ContainerStarted","Data":"872ca8eddc0b17f990ed7fde9cd9b74089a82d72c270237b137037e45a817edd"} Sep 17 21:59:50.229641 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:50.229616 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a73798_b21a_4884_b5bc_e215a1caeea3.slice/crio-e018bd6fcadad65d46bfbdc1c5b907146528cb291ce022ecf48434834ece7ba0 WatchSource:0}: Error finding container e018bd6fcadad65d46bfbdc1c5b907146528cb291ce022ecf48434834ece7ba0: Status 404 returned error can't find the container with id e018bd6fcadad65d46bfbdc1c5b907146528cb291ce022ecf48434834ece7ba0 Sep 17 21:59:50.229845 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:50.229823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq5ht" event={"ID":"a09779a6-cc7c-4067-89e2-b8c34304ce17","Type":"ContainerStarted","Data":"c6d033812e400c7edf2ad2336d72b1732c865d7509d88c230660fea665ac1cbd"} Sep 17 21:59:50.245473 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:50.245353 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gmgh8" podStartSLOduration=1.666836688 podStartE2EDuration="5.245332222s" totalImagesPullingTime="3.578495534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:50.24458571 +0000 UTC m=+52.595792353" watchObservedRunningTime="2026-09-17 21:59:50.245332222 +0000 UTC m=+52.596538868" Sep 17 21:59:50.261760 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:50.261709 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m4lk9" podStartSLOduration=1.447634483 podStartE2EDuration="5.261693631s" totalImagesPullingTime="3.814059148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:50.260902831 +0000 UTC m=+52.612109479" watchObservedRunningTime="2026-09-17 21:59:50.261693631 +0000 UTC m=+52.612900266" Sep 17 21:59:51.236195 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:51.236152 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-985dbf6b7-dsmhs" event={"ID":"92a73798-b21a-4884-b5bc-e215a1caeea3","Type":"ContainerStarted","Data":"e018bd6fcadad65d46bfbdc1c5b907146528cb291ce022ecf48434834ece7ba0"} Sep 17 21:59:51.239149 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:51.239074 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bq5ht" event={"ID":"a09779a6-cc7c-4067-89e2-b8c34304ce17","Type":"ContainerStarted","Data":"2a6b0c718d7975b02cc44201d483b3934bc31b8260e543f084c863ebde0d84bf"} Sep 17 21:59:51.239399 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:51.239353 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bq5ht" Sep 17 21:59:51.242000 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:51.241970 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" event={"ID":"80ed96cf-0293-408d-806d-91269c0b352a","Type":"ContainerStarted","Data":"8a78ebfcf6c7e00a9400c6b1b522b92762c5ec370802943946fb73d1bffb743a"} Sep 17 21:59:51.258566 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:51.257648 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bq5ht" podStartSLOduration=2.519598882 podStartE2EDuration="6.25762485s" totalImagesPullingTime="3.738025968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:51.257407788 +0000 UTC m=+53.608614432" watchObservedRunningTime="2026-09-17 21:59:51.25762485 +0000 UTC m=+53.608831495" Sep 17 21:59:55.257942 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.257666 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" event={"ID":"80ed96cf-0293-408d-806d-91269c0b352a","Type":"ContainerStarted","Data":"9a2adba1f5d8abdda48e600859e2527b569e486ce21eac47729d6b1da7585041"} Sep 17 21:59:55.257942 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.257921 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" Sep 17 21:59:55.262670 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.262646 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" Sep 17 21:59:55.273681 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.273632 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-6fx74" podStartSLOduration=4.51426706 podStartE2EDuration="9.273618006s" totalImagesPullingTime="4.759350946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:55.273168755 +0000 UTC m=+57.624375400" watchObservedRunningTime="2026-09-17 21:59:55.273618006 +0000 UTC m=+57.624824650" Sep 17 21:59:55.902410 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.902372 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md"] Sep 17 21:59:55.924555 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.924520 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md"] Sep 17 21:59:55.924715 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.924653 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:55.927603 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.927581 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 21:59:55.927721 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.927627 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 21:59:55.928393 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.928374 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 21:59:55.928477 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.928374 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 21:59:55.928581 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.928564 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 21:59:55.928625 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.928569 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-djk2w\"" Sep 17 21:59:55.990210 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.990177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/db128b62-1113-4364-b05d-86e06e250042-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:55.990210 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.990208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db128b62-1113-4364-b05d-86e06e250042-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:55.990406 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.990227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk4tv\" (UniqueName: \"kubernetes.io/projected/db128b62-1113-4364-b05d-86e06e250042-kube-api-access-mk4tv\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:55.990406 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:55.990244 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db128b62-1113-4364-b05d-86e06e250042-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.090876 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.090839 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/db128b62-1113-4364-b05d-86e06e250042-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.090876 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.090877 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db128b62-1113-4364-b05d-86e06e250042-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.091116 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.090900 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk4tv\" (UniqueName: \"kubernetes.io/projected/db128b62-1113-4364-b05d-86e06e250042-kube-api-access-mk4tv\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.091116 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.090944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db128b62-1113-4364-b05d-86e06e250042-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.091716 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.091695 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db128b62-1113-4364-b05d-86e06e250042-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.095071 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.095044 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/db128b62-1113-4364-b05d-86e06e250042-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.095178 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.095043 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db128b62-1113-4364-b05d-86e06e250042-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.099512 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.099476 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk4tv\" (UniqueName: \"kubernetes.io/projected/db128b62-1113-4364-b05d-86e06e250042-kube-api-access-mk4tv\") pod \"prometheus-operator-7bd5d56d6-tz5md\" (UID: \"db128b62-1113-4364-b05d-86e06e250042\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.233993 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.233953 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" Sep 17 21:59:56.267400 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.267368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-985dbf6b7-dsmhs" event={"ID":"92a73798-b21a-4884-b5bc-e215a1caeea3","Type":"ContainerStarted","Data":"7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719"} Sep 17 21:59:56.288729 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.288682 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-985dbf6b7-dsmhs" podStartSLOduration=3.167715553 podStartE2EDuration="8.288666303s" totalImagesPullingTime="5.12095075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:56.287852922 +0000 UTC m=+58.639059571" watchObservedRunningTime="2026-09-17 21:59:56.288666303 +0000 UTC m=+58.639872946" Sep 17 21:59:56.523212 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:56.523129 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md"] Sep 17 21:59:56.526308 ip-10-0-133-200 kubenswrapper[2568]: W0917 21:59:56.526270 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb128b62_1113_4364_b05d_86e06e250042.slice/crio-9a746bea3b34d8a2bc923944510632711936cb4b06c37b6e41edb9b38ee2f476 WatchSource:0}: Error finding container 9a746bea3b34d8a2bc923944510632711936cb4b06c37b6e41edb9b38ee2f476: Status 404 returned error can't find the container with id 9a746bea3b34d8a2bc923944510632711936cb4b06c37b6e41edb9b38ee2f476 Sep 17 21:59:57.272396 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:57.272362 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" event={"ID":"db128b62-1113-4364-b05d-86e06e250042","Type":"ContainerStarted","Data":"9a746bea3b34d8a2bc923944510632711936cb4b06c37b6e41edb9b38ee2f476"} Sep 17 21:59:58.153931 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:58.153880 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n26r9" Sep 17 21:59:58.277622 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:58.277585 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" event={"ID":"db128b62-1113-4364-b05d-86e06e250042","Type":"ContainerStarted","Data":"32200dc3e26aed38be888b9fd8343759eccb860a4ebbcad91bf3b3cc2677fbf0"} Sep 17 21:59:58.277984 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:58.277649 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" event={"ID":"db128b62-1113-4364-b05d-86e06e250042","Type":"ContainerStarted","Data":"7c8b4909e0214a204858a4f4361f55880f176fceb45d963b8fafb9820309b41b"} Sep 17 21:59:58.303088 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:58.303032 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tz5md" podStartSLOduration=2.321429979 podStartE2EDuration="3.303015616s" totalImagesPullingTime="981.585637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 21:59:58.302026082 +0000 UTC m=+60.653232738" watchObservedRunningTime="2026-09-17 21:59:58.303015616 +0000 UTC m=+60.654222260" Sep 17 21:59:59.281667 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:59.281645 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:59.282114 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:59.281702 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 21:59:59.286319 ip-10-0-133-200 kubenswrapper[2568]: I0917 21:59:59.286301 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 22:00:00.289548 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.289522 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 22:00:00.361295 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.361264 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv"] Sep 17 22:00:00.363975 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.363952 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.366772 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.366753 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-29rvb\"" Sep 17 22:00:00.367275 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.367241 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 22:00:00.367468 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.367455 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 22:00:00.391044 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.391022 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv"] Sep 17 22:00:00.412749 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.412716 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-v82s2"] Sep 17 22:00:00.414968 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.414942 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.416368 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.416345 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2j5gl"] Sep 17 22:00:00.420510 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.420478 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.421162 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421135 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cf8z8\"" Sep 17 22:00:00.421345 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421322 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.421530 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421506 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 22:00:00.421530 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80628eab-f558-4b2f-ac6d-5fa31a192d9e-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.421701 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421642 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.421701 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421337 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 22:00:00.421701 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.421851 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421716 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b99l4\" (UniqueName: \"kubernetes.io/projected/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-api-access-b99l4\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.421851 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80628eab-f558-4b2f-ac6d-5fa31a192d9e-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.422010 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.421988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.422068 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.422034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1225ac-c234-4db2-86c6-9875ac5cf68e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.422068 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.422061 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 22:00:00.422169 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.422087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.422169 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.422119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lk4r\" (UniqueName: \"kubernetes.io/projected/bc1225ac-c234-4db2-86c6-9875ac5cf68e-kube-api-access-7lk4r\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.423330 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.423293 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hzs49\"" Sep 17 22:00:00.423639 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.423621 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 22:00:00.424127 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.424107 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 22:00:00.424520 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.424428 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 22:00:00.432436 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.432413 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-v82s2"] Sep 17 22:00:00.522794 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.522753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-root\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.522794 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.522795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-sys\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.523070 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.522822 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-wtmp\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.523070 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.522844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtznl\" (UniqueName: \"kubernetes.io/projected/d02878b7-c37d-497a-b4aa-29173ba19cc2-kube-api-access-wtznl\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.523070 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.522885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80628eab-f558-4b2f-ac6d-5fa31a192d9e-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.523070 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.522968 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-textfile\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.523070 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.523070 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02878b7-c37d-497a-b4aa-29173ba19cc2-metrics-client-ca\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1225ac-c234-4db2-86c6-9875ac5cf68e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:00:00.523181 2568 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:00:00.523251 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-tls podName:bc1225ac-c234-4db2-86c6-9875ac5cf68e nodeName:}" failed. No retries permitted until 2026-09-17 22:00:01.023226854 +0000 UTC m=+63.374433490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-4ztkv" (UID: "bc1225ac-c234-4db2-86c6-9875ac5cf68e") : secret "openshift-state-metrics-tls" not found Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523279 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lk4r\" (UniqueName: \"kubernetes.io/projected/bc1225ac-c234-4db2-86c6-9875ac5cf68e-kube-api-access-7lk4r\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523287 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80628eab-f558-4b2f-ac6d-5fa31a192d9e-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.523353 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.523842 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80628eab-f558-4b2f-ac6d-5fa31a192d9e-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.523842 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.523842 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523425 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.523842 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-tls\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.523842 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b99l4\" (UniqueName: \"kubernetes.io/projected/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-api-access-b99l4\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.524091 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523873 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc1225ac-c234-4db2-86c6-9875ac5cf68e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.524091 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.523943 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.524187 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.524130 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80628eab-f558-4b2f-ac6d-5fa31a192d9e-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.526101 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.526077 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.526527 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.526505 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.526637 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.526615 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.538069 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.538045 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b99l4\" (UniqueName: \"kubernetes.io/projected/80628eab-f558-4b2f-ac6d-5fa31a192d9e-kube-api-access-b99l4\") pod \"kube-state-metrics-84c885658c-v82s2\" (UID: \"80628eab-f558-4b2f-ac6d-5fa31a192d9e\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.538263 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.538241 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lk4r\" (UniqueName: \"kubernetes.io/projected/bc1225ac-c234-4db2-86c6-9875ac5cf68e-kube-api-access-7lk4r\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:00.624671 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-tls\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.624671 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-root\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.624859 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624683 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-root\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.624859 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624743 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-sys\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.624859 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624790 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-wtmp\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.624859 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtznl\" (UniqueName: \"kubernetes.io/projected/d02878b7-c37d-497a-b4aa-29173ba19cc2-kube-api-access-wtznl\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.624859 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-textfile\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.625113 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.625113 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624955 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-wtmp\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.625113 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.624968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02878b7-c37d-497a-b4aa-29173ba19cc2-metrics-client-ca\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.625113 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.625019 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.625314 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.625129 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-textfile\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.625314 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.625153 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d02878b7-c37d-497a-b4aa-29173ba19cc2-sys\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.625515 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.625492 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-accelerators-collector-config\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.625689 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.625558 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d02878b7-c37d-497a-b4aa-29173ba19cc2-metrics-client-ca\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.627341 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.627319 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-tls\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.627452 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.627432 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d02878b7-c37d-497a-b4aa-29173ba19cc2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.642504 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.642477 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtznl\" (UniqueName: \"kubernetes.io/projected/d02878b7-c37d-497a-b4aa-29173ba19cc2-kube-api-access-wtznl\") pod \"node-exporter-2j5gl\" (UID: \"d02878b7-c37d-497a-b4aa-29173ba19cc2\") " pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.728210 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.728179 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" Sep 17 22:00:00.733115 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:00.733091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2j5gl" Sep 17 22:00:00.742606 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:00.742565 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02878b7_c37d_497a_b4aa_29173ba19cc2.slice/crio-ce67c338c94efb64b692c969ce1616a84416dbc39690614be033a7525f3aa80e WatchSource:0}: Error finding container ce67c338c94efb64b692c969ce1616a84416dbc39690614be033a7525f3aa80e: Status 404 returned error can't find the container with id ce67c338c94efb64b692c969ce1616a84416dbc39690614be033a7525f3aa80e Sep 17 22:00:01.004897 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.004734 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-v82s2"] Sep 17 22:00:01.008002 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:01.007970 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80628eab_f558_4b2f_ac6d_5fa31a192d9e.slice/crio-8ea2a2c237530a29d4e0aa162956d2fcbfea9cba6775d80d9248bbfaecb28184 WatchSource:0}: Error finding container 8ea2a2c237530a29d4e0aa162956d2fcbfea9cba6775d80d9248bbfaecb28184: Status 404 returned error can't find the container with id 8ea2a2c237530a29d4e0aa162956d2fcbfea9cba6775d80d9248bbfaecb28184 Sep 17 22:00:01.029192 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.029162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:01.031726 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.031696 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc1225ac-c234-4db2-86c6-9875ac5cf68e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-4ztkv\" (UID: \"bc1225ac-c234-4db2-86c6-9875ac5cf68e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:01.247377 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.247345 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bq5ht" Sep 17 22:00:01.274837 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.274763 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" Sep 17 22:00:01.291143 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.291109 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j5gl" event={"ID":"d02878b7-c37d-497a-b4aa-29173ba19cc2","Type":"ContainerStarted","Data":"ce67c338c94efb64b692c969ce1616a84416dbc39690614be033a7525f3aa80e"} Sep 17 22:00:01.292330 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.292305 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" event={"ID":"80628eab-f558-4b2f-ac6d-5fa31a192d9e","Type":"ContainerStarted","Data":"8ea2a2c237530a29d4e0aa162956d2fcbfea9cba6775d80d9248bbfaecb28184"} Sep 17 22:00:01.382422 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.382385 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 22:00:01.385380 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.385357 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.388023 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.387999 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 22:00:01.388147 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.388056 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 22:00:01.388646 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.388630 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 22:00:01.389281 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.389263 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 22:00:01.389559 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.389539 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 22:00:01.389619 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.389601 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 22:00:01.389815 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.389799 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kppg5\"" Sep 17 22:00:01.389866 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.389803 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 22:00:01.390634 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.390621 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 22:00:01.390790 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.390779 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 22:00:01.413618 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.413519 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 22:00:01.433064 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433264 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433080 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433264 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433106 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433264 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433131 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433264 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433188 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433438 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433266 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-web-config\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433438 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-config-out\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433438 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433438 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq2fx\" (UniqueName: \"kubernetes.io/projected/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-kube-api-access-rq2fx\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433636 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433454 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433636 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433636 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433555 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.433636 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.433584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534175 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534175 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq2fx\" (UniqueName: \"kubernetes.io/projected/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-kube-api-access-rq2fx\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534202 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534234 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534486 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:00:01.534255 2568 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 17 22:00:01.534486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534486 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:00:01.534323 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-main-tls podName:ca5c5203-c9e0-4a00-82f7-d2204307d3e8 nodeName:}" failed. No retries permitted until 2026-09-17 22:00:02.034304272 +0000 UTC m=+64.385510909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ca5c5203-c9e0-4a00-82f7-d2204307d3e8") : secret "alertmanager-main-tls" not found Sep 17 22:00:01.534486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534371 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534846 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534591 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534846 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534846 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534846 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534846 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534769 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-web-config\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.534846 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.534826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-config-out\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.535151 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.535022 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.535943 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:00:01.535845 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-trusted-ca-bundle podName:ca5c5203-c9e0-4a00-82f7-d2204307d3e8 nodeName:}" failed. No retries permitted until 2026-09-17 22:00:02.0358255 +0000 UTC m=+64.387032142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ca5c5203-c9e0-4a00-82f7-d2204307d3e8") : configmap references non-existent config key: ca-bundle.crt Sep 17 22:00:01.535943 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.535817 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.537994 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.537953 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-config-out\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.538212 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.538174 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.538418 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.538378 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.538799 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.538762 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.538943 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.538902 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.539022 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.538941 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.539022 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.539009 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-web-config\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.540313 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.540289 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.546016 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.545994 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq2fx\" (UniqueName: \"kubernetes.io/projected/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-kube-api-access-rq2fx\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:01.553072 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:01.553048 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv"] Sep 17 22:00:02.038817 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.038788 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:02.038944 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.038901 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:02.039454 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.039430 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:02.041456 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.041433 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca5c5203-c9e0-4a00-82f7-d2204307d3e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca5c5203-c9e0-4a00-82f7-d2204307d3e8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:02.295725 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.295639 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 22:00:02.299119 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.299085 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" event={"ID":"bc1225ac-c234-4db2-86c6-9875ac5cf68e","Type":"ContainerStarted","Data":"dd5059e4c69c630af7f932aa5846c33c2fb54a149b8a94be0a0d3d091984d902"} Sep 17 22:00:02.299244 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.299159 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" event={"ID":"bc1225ac-c234-4db2-86c6-9875ac5cf68e","Type":"ContainerStarted","Data":"bd77c0cfaccb918666efe06ca843d36cfcc28ec0160532c65482e24dd81447b0"} Sep 17 22:00:02.299244 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.299189 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" event={"ID":"bc1225ac-c234-4db2-86c6-9875ac5cf68e","Type":"ContainerStarted","Data":"c168c1dd5523d3e1a72a7ae8d812be0cf3ebd4d47a64142fcc0606ee4cd792ef"} Sep 17 22:00:02.301173 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.301142 2568 generic.go:356] "Generic (PLEG): container finished" podID="d02878b7-c37d-497a-b4aa-29173ba19cc2" containerID="f81343b0027ebcaca73cb59574d42ae68f1ac5399c8d822883378fb7d361170f" exitCode=0 Sep 17 22:00:02.301287 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.301236 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j5gl" event={"ID":"d02878b7-c37d-497a-b4aa-29173ba19cc2","Type":"ContainerDied","Data":"f81343b0027ebcaca73cb59574d42ae68f1ac5399c8d822883378fb7d361170f"} Sep 17 22:00:02.591136 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:02.591058 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 22:00:02.860795 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:02.860712 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5c5203_c9e0_4a00_82f7_d2204307d3e8.slice/crio-e40a4f3f3d970ae88874c52f7cde7635bae44af7487c4c96d6e03130e2fa6c88 WatchSource:0}: Error finding container e40a4f3f3d970ae88874c52f7cde7635bae44af7487c4c96d6e03130e2fa6c88: Status 404 returned error can't find the container with id e40a4f3f3d970ae88874c52f7cde7635bae44af7487c4c96d6e03130e2fa6c88 Sep 17 22:00:03.307632 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:03.307592 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j5gl" event={"ID":"d02878b7-c37d-497a-b4aa-29173ba19cc2","Type":"ContainerStarted","Data":"599843d527ce5556fc79708f08ade7c7f06046ca894939decda1684026b87f0c"} Sep 17 22:00:03.308076 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:03.307659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j5gl" event={"ID":"d02878b7-c37d-497a-b4aa-29173ba19cc2","Type":"ContainerStarted","Data":"9a179e04201e2883da1af0c3a53aaa4d4eb9703bf717069db9d5f85b51678dbc"} Sep 17 22:00:03.311948 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:03.310558 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" event={"ID":"80628eab-f558-4b2f-ac6d-5fa31a192d9e","Type":"ContainerStarted","Data":"a786b3bda9205f28608f76e5b58510c7d5e77fe5a0b1aa3ffc37c5447bd36a62"} Sep 17 22:00:03.311948 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:03.310699 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" event={"ID":"80628eab-f558-4b2f-ac6d-5fa31a192d9e","Type":"ContainerStarted","Data":"1112c0d3599cf3d7046a8e2451844e63eeb7d19eb04fcd475450ac5a1100026b"} Sep 17 22:00:03.311948 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:03.310732 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" event={"ID":"80628eab-f558-4b2f-ac6d-5fa31a192d9e","Type":"ContainerStarted","Data":"f0b643c263f3955bfdbbc33de4b2ae634ff57b12d67c01315ee0a92a5a0fee27"} Sep 17 22:00:03.313246 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:03.313217 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca5c5203-c9e0-4a00-82f7-d2204307d3e8","Type":"ContainerStarted","Data":"e40a4f3f3d970ae88874c52f7cde7635bae44af7487c4c96d6e03130e2fa6c88"} Sep 17 22:00:03.329047 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:03.328989 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2j5gl" podStartSLOduration=1.959618929 podStartE2EDuration="3.328967831s" totalImagesPullingTime="1.292086572s" totalInitContainerRuntime="77.26233ms" isStatefulPod=true podCreationTimestamp="2026-09-17 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:03.328369326 +0000 UTC m=+65.679575971" watchObservedRunningTime="2026-09-17 22:00:03.328967831 +0000 UTC m=+65.680174472" Sep 17 22:00:04.320944 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.320882 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" event={"ID":"bc1225ac-c234-4db2-86c6-9875ac5cf68e","Type":"ContainerStarted","Data":"a4baf5bbd11ae1f1bddfb614595a7fd699dcc2ee63b99a796e2cdd482aa4f861"} Sep 17 22:00:04.339122 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.339053 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-v82s2" podStartSLOduration=2.461148857 podStartE2EDuration="4.339029435s" totalImagesPullingTime="1.877880578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:03.352314649 +0000 UTC m=+65.703521294" watchObservedRunningTime="2026-09-17 22:00:04.339029435 +0000 UTC m=+66.690236077" Sep 17 22:00:04.339834 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.339791 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-4ztkv" podStartSLOduration=2.114814128 podStartE2EDuration="4.339777988s" totalImagesPullingTime="2.22496386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:04.337485673 +0000 UTC m=+66.688692321" watchObservedRunningTime="2026-09-17 22:00:04.339777988 +0000 UTC m=+66.690984633" Sep 17 22:00:04.395833 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.395791 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d5596c4d5-s5h4w"] Sep 17 22:00:04.398952 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.398677 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.401635 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.401598 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 22:00:04.401740 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.401639 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 22:00:04.401798 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.401738 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-61kvli557kiac\"" Sep 17 22:00:04.401798 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.401742 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nszqp\"" Sep 17 22:00:04.401954 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.401921 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 22:00:04.402027 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.402013 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 22:00:04.402086 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.402031 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 22:00:04.415955 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.415924 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d5596c4d5-s5h4w"] Sep 17 22:00:04.463782 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.463743 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.463999 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.463791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-grpc-tls\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.463999 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.463897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.463999 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.463965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-tls\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.463999 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.463989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwp6\" (UniqueName: \"kubernetes.io/projected/afa425eb-65a5-40e2-ae40-40801de2ea3a-kube-api-access-lgwp6\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.464220 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.464031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.464220 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.464112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa425eb-65a5-40e2-ae40-40801de2ea3a-metrics-client-ca\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.464220 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.464194 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.565450 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.565410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.565450 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.565452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa425eb-65a5-40e2-ae40-40801de2ea3a-metrics-client-ca\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.565715 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.565503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.565715 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.565561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.565715 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.565587 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-grpc-tls\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.565832 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.565764 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.565832 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.565816 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-tls\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.565893 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.565846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwp6\" (UniqueName: \"kubernetes.io/projected/afa425eb-65a5-40e2-ae40-40801de2ea3a-kube-api-access-lgwp6\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.566367 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.566338 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa425eb-65a5-40e2-ae40-40801de2ea3a-metrics-client-ca\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.568818 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.568766 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.568957 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.568858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.568957 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.568945 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-grpc-tls\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.569439 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.569412 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-tls\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.569548 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.569528 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.569727 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.569708 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/afa425eb-65a5-40e2-ae40-40801de2ea3a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.576584 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.576514 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwp6\" (UniqueName: \"kubernetes.io/projected/afa425eb-65a5-40e2-ae40-40801de2ea3a-kube-api-access-lgwp6\") pod \"thanos-querier-d5596c4d5-s5h4w\" (UID: \"afa425eb-65a5-40e2-ae40-40801de2ea3a\") " pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.709903 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.709872 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:04.798860 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.798830 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-89684b496-x6d6t"] Sep 17 22:00:04.800967 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.800946 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.803939 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.803899 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 22:00:04.804160 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.804037 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 22:00:04.804160 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.804064 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 22:00:04.804296 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.804179 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-l52jg\"" Sep 17 22:00:04.804296 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.804231 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 22:00:04.804405 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.804384 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-15r6985hlcabt\"" Sep 17 22:00:04.816874 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.816847 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-89684b496-x6d6t"] Sep 17 22:00:04.867966 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.867836 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-secret-metrics-server-tls\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.867966 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.867889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hf5q\" (UniqueName: \"kubernetes.io/projected/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-kube-api-access-4hf5q\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.868185 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.867993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-secret-metrics-server-client-certs\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.868185 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.868033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.868185 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.868070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-metrics-server-audit-profiles\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.868185 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.868128 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-client-ca-bundle\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.868185 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.868161 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-audit-log\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.969517 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.969480 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-secret-metrics-server-client-certs\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.969716 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.969546 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.969716 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.969586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-metrics-server-audit-profiles\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.969716 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.969648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-client-ca-bundle\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.969716 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.969683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-audit-log\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.969948 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.969722 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-secret-metrics-server-tls\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.969948 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.969755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hf5q\" (UniqueName: \"kubernetes.io/projected/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-kube-api-access-4hf5q\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.970264 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.970235 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-audit-log\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.970375 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.970353 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.970634 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.970611 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-metrics-server-audit-profiles\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.972304 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.972280 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-secret-metrics-server-client-certs\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.972446 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.972424 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-client-ca-bundle\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.972543 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.972528 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-secret-metrics-server-tls\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.979000 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.978970 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hf5q\" (UniqueName: \"kubernetes.io/projected/483ceece-3a5a-4fd4-9ce0-dd9d6a417c23-kube-api-access-4hf5q\") pod \"metrics-server-89684b496-x6d6t\" (UID: \"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23\") " pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:04.989971 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:04.989808 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d5596c4d5-s5h4w"] Sep 17 22:00:04.992424 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:04.992394 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa425eb_65a5_40e2_ae40_40801de2ea3a.slice/crio-f887b681e4de769bb777ef782709f2737603d452b3209eb0ce961304e8856e30 WatchSource:0}: Error finding container f887b681e4de769bb777ef782709f2737603d452b3209eb0ce961304e8856e30: Status 404 returned error can't find the container with id f887b681e4de769bb777ef782709f2737603d452b3209eb0ce961304e8856e30 Sep 17 22:00:05.096865 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.095493 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m"] Sep 17 22:00:05.099995 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.099961 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f67d9cbb-m5vcp"] Sep 17 22:00:05.100146 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.100094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:05.102236 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.102213 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.103066 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.103042 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tzz9r\"" Sep 17 22:00:05.103289 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.103273 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 22:00:05.109865 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.109844 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:05.115043 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.114885 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m"] Sep 17 22:00:05.119320 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.119291 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f67d9cbb-m5vcp"] Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jb8l\" (UniqueName: \"kubernetes.io/projected/06a28afe-4d0c-4629-8e43-2d2bbecf252d-kube-api-access-5jb8l\") pod \"monitoring-plugin-5984459ff8-9bq9m\" (UID: \"06a28afe-4d0c-4629-8e43-2d2bbecf252d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172392 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-console-config\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172436 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjmr9\" (UniqueName: \"kubernetes.io/projected/5a57658d-262b-4e56-90ca-f36f39095804-kube-api-access-qjmr9\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-serving-cert\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172498 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-service-ca\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-oauth-serving-cert\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172533 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-oauth-config\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172565 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-trusted-ca-bundle\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.172862 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.172579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06a28afe-4d0c-4629-8e43-2d2bbecf252d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9bq9m\" (UID: \"06a28afe-4d0c-4629-8e43-2d2bbecf252d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:05.273101 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273071 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-service-ca\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.273101 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-oauth-serving-cert\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.273340 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273124 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-oauth-config\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.273340 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-trusted-ca-bundle\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.273340 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273277 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06a28afe-4d0c-4629-8e43-2d2bbecf252d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9bq9m\" (UID: \"06a28afe-4d0c-4629-8e43-2d2bbecf252d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:05.273486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273372 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jb8l\" (UniqueName: \"kubernetes.io/projected/06a28afe-4d0c-4629-8e43-2d2bbecf252d-kube-api-access-5jb8l\") pod \"monitoring-plugin-5984459ff8-9bq9m\" (UID: \"06a28afe-4d0c-4629-8e43-2d2bbecf252d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:05.273486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-console-config\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.273486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273462 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjmr9\" (UniqueName: \"kubernetes.io/projected/5a57658d-262b-4e56-90ca-f36f39095804-kube-api-access-qjmr9\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.273625 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-serving-cert\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.273960 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273931 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-oauth-serving-cert\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.274078 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.273974 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-service-ca\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.274294 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.274245 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-trusted-ca-bundle\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.274550 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.274525 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-console-config\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.275867 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.275840 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-oauth-config\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.276028 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.276010 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06a28afe-4d0c-4629-8e43-2d2bbecf252d-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9bq9m\" (UID: \"06a28afe-4d0c-4629-8e43-2d2bbecf252d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:05.276112 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.276064 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-serving-cert\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.286405 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.286375 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jb8l\" (UniqueName: \"kubernetes.io/projected/06a28afe-4d0c-4629-8e43-2d2bbecf252d-kube-api-access-5jb8l\") pod \"monitoring-plugin-5984459ff8-9bq9m\" (UID: \"06a28afe-4d0c-4629-8e43-2d2bbecf252d\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:05.286486 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.286420 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjmr9\" (UniqueName: \"kubernetes.io/projected/5a57658d-262b-4e56-90ca-f36f39095804-kube-api-access-qjmr9\") pod \"console-86f67d9cbb-m5vcp\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.326763 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.326729 2568 generic.go:356] "Generic (PLEG): container finished" podID="ca5c5203-c9e0-4a00-82f7-d2204307d3e8" containerID="a93be46bbd7e79a1338751b3668b793631821168dc19aaaa84fa7de448e46b2d" exitCode=0 Sep 17 22:00:05.327218 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.326818 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca5c5203-c9e0-4a00-82f7-d2204307d3e8","Type":"ContainerDied","Data":"a93be46bbd7e79a1338751b3668b793631821168dc19aaaa84fa7de448e46b2d"} Sep 17 22:00:05.328274 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.328249 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" event={"ID":"afa425eb-65a5-40e2-ae40-40801de2ea3a","Type":"ContainerStarted","Data":"f887b681e4de769bb777ef782709f2737603d452b3209eb0ce961304e8856e30"} Sep 17 22:00:05.398762 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.398737 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-89684b496-x6d6t"] Sep 17 22:00:05.401064 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:05.401036 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483ceece_3a5a_4fd4_9ce0_dd9d6a417c23.slice/crio-7740807f70628e417fb6b34e8e71f710215fadb7b260a5153d4bb339323663d9 WatchSource:0}: Error finding container 7740807f70628e417fb6b34e8e71f710215fadb7b260a5153d4bb339323663d9: Status 404 returned error can't find the container with id 7740807f70628e417fb6b34e8e71f710215fadb7b260a5153d4bb339323663d9 Sep 17 22:00:05.411259 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.411235 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:05.419232 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.419213 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:05.476521 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.476488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 22:00:05.476652 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.476558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 22:00:05.480521 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.480348 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 22:00:05.480635 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.480579 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 22:00:05.489345 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.489325 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f735753-7333-48b5-9d5f-6f4dda9f29e1-metrics-certs\") pod \"network-metrics-daemon-hbsxf\" (UID: \"0f735753-7333-48b5-9d5f-6f4dda9f29e1\") " pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 22:00:05.489554 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.489531 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1321b96a-f1b2-40fa-b0aa-d924b37e1e44-original-pull-secret\") pod \"global-pull-secret-syncer-6rktt\" (UID: \"1321b96a-f1b2-40fa-b0aa-d924b37e1e44\") " pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 22:00:05.667852 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.667771 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rktt" Sep 17 22:00:05.678551 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.678523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 22:00:05.681496 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.681476 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 22:00:05.689467 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.689445 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m"] Sep 17 22:00:05.691325 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:05.691301 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a28afe_4d0c_4629_8e43_2d2bbecf252d.slice/crio-f66f44535543f866f0524a2a4de39c6e4836ac6f858cde409e736d654c16e31d WatchSource:0}: Error finding container f66f44535543f866f0524a2a4de39c6e4836ac6f858cde409e736d654c16e31d: Status 404 returned error can't find the container with id f66f44535543f866f0524a2a4de39c6e4836ac6f858cde409e736d654c16e31d Sep 17 22:00:05.691538 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.691523 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 22:00:05.700199 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.700165 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f67d9cbb-m5vcp"] Sep 17 22:00:05.701591 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.701569 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgz4s\" (UniqueName: \"kubernetes.io/projected/1289970f-e82e-447e-8eb4-760ee40dc1e2-kube-api-access-kgz4s\") pod \"network-check-target-88wh9\" (UID: \"1289970f-e82e-447e-8eb4-760ee40dc1e2\") " pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 22:00:05.701741 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:05.701720 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a57658d_262b_4e56_90ca_f36f39095804.slice/crio-2157b81d6d52e46d382061c98bed653ee7ba01ccbde8b20fbadc5393e61fbe6b WatchSource:0}: Error finding container 2157b81d6d52e46d382061c98bed653ee7ba01ccbde8b20fbadc5393e61fbe6b: Status 404 returned error can't find the container with id 2157b81d6d52e46d382061c98bed653ee7ba01ccbde8b20fbadc5393e61fbe6b Sep 17 22:00:05.773951 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.773901 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ks7q\"" Sep 17 22:00:05.781775 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.781743 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hbsxf" Sep 17 22:00:05.793828 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.793807 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q7xxp\"" Sep 17 22:00:05.801325 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.801299 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 22:00:05.944136 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:05.944104 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rktt"] Sep 17 22:00:05.946592 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:05.946550 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1321b96a_f1b2_40fa_b0aa_d924b37e1e44.slice/crio-cca91bda631dfa2da01a71bd7104fb5b8e39ae1165007c465ad31cb88b154670 WatchSource:0}: Error finding container cca91bda631dfa2da01a71bd7104fb5b8e39ae1165007c465ad31cb88b154670: Status 404 returned error can't find the container with id cca91bda631dfa2da01a71bd7104fb5b8e39ae1165007c465ad31cb88b154670 Sep 17 22:00:06.093657 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:06.093611 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f735753_7333_48b5_9d5f_6f4dda9f29e1.slice/crio-2ffa1c10b887b6673d0dd89a14c04d34c5ed3b68006f90e3914344cb20f485cf WatchSource:0}: Error finding container 2ffa1c10b887b6673d0dd89a14c04d34c5ed3b68006f90e3914344cb20f485cf: Status 404 returned error can't find the container with id 2ffa1c10b887b6673d0dd89a14c04d34c5ed3b68006f90e3914344cb20f485cf Sep 17 22:00:06.097666 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.097531 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hbsxf"] Sep 17 22:00:06.114090 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.114042 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-88wh9"] Sep 17 22:00:06.118459 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:06.118413 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1289970f_e82e_447e_8eb4_760ee40dc1e2.slice/crio-c25d1cd13284a48a659e74dc77dc7f97874c24376cd02bf46ad2b3a684afd213 WatchSource:0}: Error finding container c25d1cd13284a48a659e74dc77dc7f97874c24376cd02bf46ad2b3a684afd213: Status 404 returned error can't find the container with id c25d1cd13284a48a659e74dc77dc7f97874c24376cd02bf46ad2b3a684afd213 Sep 17 22:00:06.344438 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.344310 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbsxf" event={"ID":"0f735753-7333-48b5-9d5f-6f4dda9f29e1","Type":"ContainerStarted","Data":"2ffa1c10b887b6673d0dd89a14c04d34c5ed3b68006f90e3914344cb20f485cf"} Sep 17 22:00:06.347551 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.347513 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rktt" event={"ID":"1321b96a-f1b2-40fa-b0aa-d924b37e1e44","Type":"ContainerStarted","Data":"cca91bda631dfa2da01a71bd7104fb5b8e39ae1165007c465ad31cb88b154670"} Sep 17 22:00:06.349522 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.349457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" event={"ID":"06a28afe-4d0c-4629-8e43-2d2bbecf252d","Type":"ContainerStarted","Data":"f66f44535543f866f0524a2a4de39c6e4836ac6f858cde409e736d654c16e31d"} Sep 17 22:00:06.357078 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.354673 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f67d9cbb-m5vcp" event={"ID":"5a57658d-262b-4e56-90ca-f36f39095804","Type":"ContainerStarted","Data":"e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7"} Sep 17 22:00:06.357078 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.354723 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f67d9cbb-m5vcp" event={"ID":"5a57658d-262b-4e56-90ca-f36f39095804","Type":"ContainerStarted","Data":"2157b81d6d52e46d382061c98bed653ee7ba01ccbde8b20fbadc5393e61fbe6b"} Sep 17 22:00:06.357802 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.357748 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" event={"ID":"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23","Type":"ContainerStarted","Data":"7740807f70628e417fb6b34e8e71f710215fadb7b260a5153d4bb339323663d9"} Sep 17 22:00:06.360946 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.360848 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-88wh9" event={"ID":"1289970f-e82e-447e-8eb4-760ee40dc1e2","Type":"ContainerStarted","Data":"c25d1cd13284a48a659e74dc77dc7f97874c24376cd02bf46ad2b3a684afd213"} Sep 17 22:00:06.382295 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.382220 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f67d9cbb-m5vcp" podStartSLOduration=1.382200767 podStartE2EDuration="1.382200767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:06.381742568 +0000 UTC m=+68.732949212" watchObservedRunningTime="2026-09-17 22:00:06.382200767 +0000 UTC m=+68.733407411" Sep 17 22:00:06.677235 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.675240 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 22:00:06.678881 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.678855 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.683827 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.683801 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 22:00:06.684997 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.684975 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 22:00:06.685248 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.685214 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 22:00:06.685438 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.685423 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bvpm37r37r9c8\"" Sep 17 22:00:06.685724 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.685703 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 22:00:06.685995 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.685953 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-l4pb7\"" Sep 17 22:00:06.686209 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.686191 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 22:00:06.686412 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.686394 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 22:00:06.686593 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.686578 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 22:00:06.686775 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.686760 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 22:00:06.687048 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.687031 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 22:00:06.687258 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.687243 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 22:00:06.690115 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.687423 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 22:00:06.690115 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.687933 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 22:00:06.690115 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.687998 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 22:00:06.690115 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.689947 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 22:00:06.698275 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.698170 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 22:00:06.789695 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.789655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.789835 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.789703 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.789835 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.789804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.789939 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.789848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/568bc314-dc43-4d6a-8ab5-adb53448059f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.789939 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.789883 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790015 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.789941 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790015 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.789989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790074 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-config\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790074 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790040 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-web-config\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790130 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790098 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790130 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790124 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790188 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790188 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/568bc314-dc43-4d6a-8ab5-adb53448059f-config-out\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790244 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790206 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790244 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wp52\" (UniqueName: \"kubernetes.io/projected/568bc314-dc43-4d6a-8ab5-adb53448059f-kube-api-access-8wp52\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790301 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790337 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790369 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790404 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790389 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.790448 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.790433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.891902 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.891859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892097 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.891925 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892097 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.891967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892097 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/568bc314-dc43-4d6a-8ab5-adb53448059f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892097 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892035 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892097 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892069 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892118 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-config\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-web-config\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892274 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/568bc314-dc43-4d6a-8ab5-adb53448059f-config-out\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892356 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wp52\" (UniqueName: \"kubernetes.io/projected/568bc314-dc43-4d6a-8ab5-adb53448059f-kube-api-access-8wp52\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892802 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892391 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892802 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892802 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892451 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892802 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892802 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892506 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.892802 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.892787 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.893235 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.893051 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.894153 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.894116 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.895116 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.894649 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.895116 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.894929 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.897514 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.897230 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.899644 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.898862 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.899644 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.899335 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/568bc314-dc43-4d6a-8ab5-adb53448059f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.903428 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.903344 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.906328 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.906244 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.906328 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.906306 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/568bc314-dc43-4d6a-8ab5-adb53448059f-config-out\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.907014 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.906961 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.907123 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.907067 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-web-config\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.907738 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.907712 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/568bc314-dc43-4d6a-8ab5-adb53448059f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.908671 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.908624 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.908784 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.908671 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wp52\" (UniqueName: \"kubernetes.io/projected/568bc314-dc43-4d6a-8ab5-adb53448059f-kube-api-access-8wp52\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.909187 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.909147 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.909973 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.909440 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.909973 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.909940 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:06.911251 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:06.911228 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/568bc314-dc43-4d6a-8ab5-adb53448059f-config\") pod \"prometheus-k8s-0\" (UID: \"568bc314-dc43-4d6a-8ab5-adb53448059f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:07.006816 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:07.006478 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:09.331515 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:09.331483 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 22:00:09.484774 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:00:09.484743 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568bc314_dc43_4d6a_8ab5_adb53448059f.slice/crio-6e4b7426113ea373608e7b95c33bdd8ec08c23bad8fa90eb2ae322eb88d27303 WatchSource:0}: Error finding container 6e4b7426113ea373608e7b95c33bdd8ec08c23bad8fa90eb2ae322eb88d27303: Status 404 returned error can't find the container with id 6e4b7426113ea373608e7b95c33bdd8ec08c23bad8fa90eb2ae322eb88d27303 Sep 17 22:00:10.382050 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:10.382012 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"568bc314-dc43-4d6a-8ab5-adb53448059f","Type":"ContainerStarted","Data":"6e4b7426113ea373608e7b95c33bdd8ec08c23bad8fa90eb2ae322eb88d27303"} Sep 17 22:00:12.394313 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.394208 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" event={"ID":"483ceece-3a5a-4fd4-9ce0-dd9d6a417c23","Type":"ContainerStarted","Data":"9c2e771d2816a38be7dac16a58c0d86933422056649a3a93a044cb3e3c375479"} Sep 17 22:00:12.395898 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.395873 2568 generic.go:356] "Generic (PLEG): container finished" podID="568bc314-dc43-4d6a-8ab5-adb53448059f" containerID="a2e1aa193efb29aacea6e08238ea827bafcd62bc4f003fe516b025aca355d510" exitCode=0 Sep 17 22:00:12.396030 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.395966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"568bc314-dc43-4d6a-8ab5-adb53448059f","Type":"ContainerDied","Data":"a2e1aa193efb29aacea6e08238ea827bafcd62bc4f003fe516b025aca355d510"} Sep 17 22:00:12.397792 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.397765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" event={"ID":"06a28afe-4d0c-4629-8e43-2d2bbecf252d","Type":"ContainerStarted","Data":"07074926cb8dd9dd369497eaad134f045b59d3a730c440cf0650e50487b87e5a"} Sep 17 22:00:12.397965 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.397903 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:12.399579 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.399560 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-88wh9" event={"ID":"1289970f-e82e-447e-8eb4-760ee40dc1e2","Type":"ContainerStarted","Data":"7eef30ea875a0651d220db58b7332d48d2472ab34c771efd0bbbe0339d9d3d66"} Sep 17 22:00:12.399721 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.399706 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 22:00:12.403057 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.403032 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca5c5203-c9e0-4a00-82f7-d2204307d3e8","Type":"ContainerStarted","Data":"4558cfa6f0d3a989ccbf545801984512927da362dcae02d2b001cd305862c2c0"} Sep 17 22:00:12.403161 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.403100 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca5c5203-c9e0-4a00-82f7-d2204307d3e8","Type":"ContainerStarted","Data":"a8c4c94ceb62d7b2ecebbcba8fee8b173b3698a56d7cd2d45df1cb63d8f8d7a5"} Sep 17 22:00:12.403208 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.403172 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca5c5203-c9e0-4a00-82f7-d2204307d3e8","Type":"ContainerStarted","Data":"8178c7f2afedf8089698f5babc8a78f9f41591fd210554683969972a63d2ce0e"} Sep 17 22:00:12.403240 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.403211 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca5c5203-c9e0-4a00-82f7-d2204307d3e8","Type":"ContainerStarted","Data":"078be25a291811071feba198b7bc06ee38138f4ba0539c949d500a4116edc82f"} Sep 17 22:00:12.403281 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.403248 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca5c5203-c9e0-4a00-82f7-d2204307d3e8","Type":"ContainerStarted","Data":"30af234d3f27a30134a6226dff6e25a3c0874ef78d1002a733a8483663270cae"} Sep 17 22:00:12.403740 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.403721 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" Sep 17 22:00:12.404752 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.404731 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rktt" event={"ID":"1321b96a-f1b2-40fa-b0aa-d924b37e1e44","Type":"ContainerStarted","Data":"b6d556c1d9dea3e21248d6140dc5de068243f28e27339202897d1885defd0b9d"} Sep 17 22:00:12.406791 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.406770 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbsxf" event={"ID":"0f735753-7333-48b5-9d5f-6f4dda9f29e1","Type":"ContainerStarted","Data":"02f81e459769c46129afc2f274ba2df843d2ec574fafff7427d36d572dc78134"} Sep 17 22:00:12.406868 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.406812 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hbsxf" event={"ID":"0f735753-7333-48b5-9d5f-6f4dda9f29e1","Type":"ContainerStarted","Data":"003293e9af7ca4a2214aa96ff77f63878a9ee8f1364e6844e18b568f5f2ae771"} Sep 17 22:00:12.408900 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.408882 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" event={"ID":"afa425eb-65a5-40e2-ae40-40801de2ea3a","Type":"ContainerStarted","Data":"901f7432a1c2985c99b1607a74bec2c4a0c4cd3a95e792b86933b0fe9f6a1ffc"} Sep 17 22:00:12.409002 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.408951 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" event={"ID":"afa425eb-65a5-40e2-ae40-40801de2ea3a","Type":"ContainerStarted","Data":"d34575c0ddfdd9c55e41af2c1358fd87321e89ef1a9e1cc42eeee5310b04390a"} Sep 17 22:00:12.409002 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.408978 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" event={"ID":"afa425eb-65a5-40e2-ae40-40801de2ea3a","Type":"ContainerStarted","Data":"cda6f63c7f4d9485fed1fecf0d8d68f13eb07565fb85c3f2d4391dba8c7bebe2"} Sep 17 22:00:12.430481 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.430424 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6rktt" podStartSLOduration=66.496856436 podStartE2EDuration="1m12.43040578s" totalImagesPullingTime="5.933549344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:12.429293867 +0000 UTC m=+74.780500514" watchObservedRunningTime="2026-09-17 22:00:12.43040578 +0000 UTC m=+74.781612477" Sep 17 22:00:12.430672 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.430653 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" podStartSLOduration=4.789917948 podStartE2EDuration="8.430647565s" totalImagesPullingTime="3.640729617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:12.413504515 +0000 UTC m=+74.764711160" watchObservedRunningTime="2026-09-17 22:00:12.430647565 +0000 UTC m=+74.781854206" Sep 17 22:00:12.446768 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.446715 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-88wh9" podStartSLOduration=66.685623702 podStartE2EDuration="1m12.446699206s" totalImagesPullingTime="5.761075504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:12.445491595 +0000 UTC m=+74.796698273" watchObservedRunningTime="2026-09-17 22:00:12.446699206 +0000 UTC m=+74.797905849" Sep 17 22:00:12.462848 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.462796 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9bq9m" podStartSLOduration=1.292479865 podStartE2EDuration="7.462780992s" totalImagesPullingTime="6.170301127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:12.46252887 +0000 UTC m=+74.813735515" watchObservedRunningTime="2026-09-17 22:00:12.462780992 +0000 UTC m=+74.813987637" Sep 17 22:00:12.509388 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:12.509338 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hbsxf" podStartSLOduration=67.749543879 podStartE2EDuration="1m13.509323735s" totalImagesPullingTime="5.759779856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 21:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:12.50920132 +0000 UTC m=+74.860407966" watchObservedRunningTime="2026-09-17 22:00:12.509323735 +0000 UTC m=+74.860530378" Sep 17 22:00:13.419493 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:13.419402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" event={"ID":"afa425eb-65a5-40e2-ae40-40801de2ea3a","Type":"ContainerStarted","Data":"d9167ef30f1f3c0ac1493041852d6a2c3abab3e6fc5c2f6afa8986ae7e27471d"} Sep 17 22:00:13.419867 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:13.419516 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" event={"ID":"afa425eb-65a5-40e2-ae40-40801de2ea3a","Type":"ContainerStarted","Data":"6f19663af07fc50f1e106a74a22ab50d0e04f121de0f71020debacb69b1c0a83"} Sep 17 22:00:13.419867 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:13.419559 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" event={"ID":"afa425eb-65a5-40e2-ae40-40801de2ea3a","Type":"ContainerStarted","Data":"764b03b4fa5f06116dfe3b84acf479cdddd53be0022f949161a818ce7debee37"} Sep 17 22:00:13.444491 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:13.444441 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" podStartSLOduration=4.688525372 podStartE2EDuration="9.444423191s" totalImagesPullingTime="4.755897819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:13.442336385 +0000 UTC m=+75.793543030" watchObservedRunningTime="2026-09-17 22:00:13.444423191 +0000 UTC m=+75.795629835" Sep 17 22:00:14.428872 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:14.428785 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca5c5203-c9e0-4a00-82f7-d2204307d3e8","Type":"ContainerStarted","Data":"d8ed90c6ce56cdb45b300cc3e5b8d730d677cb0c0618bf7651b583225622ce82"} Sep 17 22:00:14.429431 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:14.429404 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:14.459623 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:14.459550 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.62636812 podStartE2EDuration="13.459527681s" totalImagesPullingTime="6.81515981s" totalInitContainerRuntime="17.999751ms" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:14.456480076 +0000 UTC m=+76.807686729" watchObservedRunningTime="2026-09-17 22:00:14.459527681 +0000 UTC m=+76.810734326" Sep 17 22:00:15.419737 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:15.419713 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:15.419867 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:15.419771 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:15.424655 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:15.424630 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:15.437508 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:15.437481 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:00:15.490723 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:15.490700 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-985dbf6b7-dsmhs"] Sep 17 22:00:16.442023 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:16.441985 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"568bc314-dc43-4d6a-8ab5-adb53448059f","Type":"ContainerStarted","Data":"9011fe34ef2d974bf4bdbc71530ed3d834259444a414a5775030d1126f0fe410"} Sep 17 22:00:16.442447 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:16.442068 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"568bc314-dc43-4d6a-8ab5-adb53448059f","Type":"ContainerStarted","Data":"a6ad35443e2a08a0ecabb9a4d89c7522726f8044f6973c45b7d5e2672a4a9584"} Sep 17 22:00:16.442447 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:16.442111 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"568bc314-dc43-4d6a-8ab5-adb53448059f","Type":"ContainerStarted","Data":"fde69cf83cd514286db56b5c1d951ad296a30ca3a9677f1cfcddab468dedbbcc"} Sep 17 22:00:16.442447 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:16.442138 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"568bc314-dc43-4d6a-8ab5-adb53448059f","Type":"ContainerStarted","Data":"cd4d1af2ac54347d49a9823e3f2583ab2eaf3769a52869fd4effbddf6db423fd"} Sep 17 22:00:16.442447 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:16.442163 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"568bc314-dc43-4d6a-8ab5-adb53448059f","Type":"ContainerStarted","Data":"f8f9de54de9c4322ff1f4b2d33af9d33213c5752aec0eaddfc899f826a6feaa1"} Sep 17 22:00:16.442447 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:16.442187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"568bc314-dc43-4d6a-8ab5-adb53448059f","Type":"ContainerStarted","Data":"d680388a92e6e25d08d82f3f3b829b2ca35875b012b6169c2a1f085c98eb4475"} Sep 17 22:00:16.478180 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:16.478108 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.404813324 podStartE2EDuration="10.478085305s" totalImagesPullingTime="3.012351755s" totalInitContainerRuntime="60.920226ms" isStatefulPod=false podCreationTimestamp="2026-09-17 22:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:00:16.476081947 +0000 UTC m=+78.827288592" watchObservedRunningTime="2026-09-17 22:00:16.478085305 +0000 UTC m=+78.829291951" Sep 17 22:00:17.006931 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:17.006870 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:00:20.439239 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:20.439211 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d5596c4d5-s5h4w" Sep 17 22:00:25.110696 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:25.110661 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:25.111105 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:25.110720 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:29.090492 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:29.090456 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m4lk9_15ea6a3f-16d5-412e-8426-5ad259951ef8/serve-healthcheck-canary/0.log" Sep 17 22:00:40.517420 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.517358 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-985dbf6b7-dsmhs" podUID="92a73798-b21a-4884-b5bc-e215a1caeea3" containerName="console" containerID="cri-o://7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719" gracePeriod=15 Sep 17 22:00:40.822359 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.822331 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 22:00:40.906478 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.906441 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-console-config\") pod \"92a73798-b21a-4884-b5bc-e215a1caeea3\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " Sep 17 22:00:40.906680 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.906505 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-oauth-config\") pod \"92a73798-b21a-4884-b5bc-e215a1caeea3\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " Sep 17 22:00:40.906680 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.906529 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-trusted-ca-bundle\") pod \"92a73798-b21a-4884-b5bc-e215a1caeea3\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " Sep 17 22:00:40.906680 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.906572 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg6zz\" (UniqueName: \"kubernetes.io/projected/92a73798-b21a-4884-b5bc-e215a1caeea3-kube-api-access-wg6zz\") pod \"92a73798-b21a-4884-b5bc-e215a1caeea3\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " Sep 17 22:00:40.906680 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.906608 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-service-ca\") pod \"92a73798-b21a-4884-b5bc-e215a1caeea3\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " Sep 17 22:00:40.906680 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.906639 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-serving-cert\") pod \"92a73798-b21a-4884-b5bc-e215a1caeea3\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " Sep 17 22:00:40.907033 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.906684 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-oauth-serving-cert\") pod \"92a73798-b21a-4884-b5bc-e215a1caeea3\" (UID: \"92a73798-b21a-4884-b5bc-e215a1caeea3\") " Sep 17 22:00:40.907033 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.906824 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-console-config" (OuterVolumeSpecName: "console-config") pod "92a73798-b21a-4884-b5bc-e215a1caeea3" (UID: "92a73798-b21a-4884-b5bc-e215a1caeea3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:00:40.907157 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.907046 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-console-config\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:00:40.907157 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.907029 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92a73798-b21a-4884-b5bc-e215a1caeea3" (UID: "92a73798-b21a-4884-b5bc-e215a1caeea3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:00:40.907157 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.907132 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92a73798-b21a-4884-b5bc-e215a1caeea3" (UID: "92a73798-b21a-4884-b5bc-e215a1caeea3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:00:40.907315 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.907188 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-service-ca" (OuterVolumeSpecName: "service-ca") pod "92a73798-b21a-4884-b5bc-e215a1caeea3" (UID: "92a73798-b21a-4884-b5bc-e215a1caeea3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:00:40.909313 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.909287 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92a73798-b21a-4884-b5bc-e215a1caeea3" (UID: "92a73798-b21a-4884-b5bc-e215a1caeea3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:00:40.909436 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.909341 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a73798-b21a-4884-b5bc-e215a1caeea3-kube-api-access-wg6zz" (OuterVolumeSpecName: "kube-api-access-wg6zz") pod "92a73798-b21a-4884-b5bc-e215a1caeea3" (UID: "92a73798-b21a-4884-b5bc-e215a1caeea3"). InnerVolumeSpecName "kube-api-access-wg6zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:00:40.909436 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:40.909370 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92a73798-b21a-4884-b5bc-e215a1caeea3" (UID: "92a73798-b21a-4884-b5bc-e215a1caeea3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:00:41.007897 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.007863 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg6zz\" (UniqueName: \"kubernetes.io/projected/92a73798-b21a-4884-b5bc-e215a1caeea3-kube-api-access-wg6zz\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:00:41.007897 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.007892 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-service-ca\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:00:41.007897 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.007902 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-serving-cert\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:00:41.008155 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.007937 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-oauth-serving-cert\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:00:41.008155 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.007945 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92a73798-b21a-4884-b5bc-e215a1caeea3-console-oauth-config\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:00:41.008155 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.007953 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a73798-b21a-4884-b5bc-e215a1caeea3-trusted-ca-bundle\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:00:41.553846 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.553814 2568 generic.go:356] "Generic (PLEG): container finished" podID="92a73798-b21a-4884-b5bc-e215a1caeea3" containerID="7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719" exitCode=0 Sep 17 22:00:41.554333 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.553940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-985dbf6b7-dsmhs" event={"ID":"92a73798-b21a-4884-b5bc-e215a1caeea3","Type":"ContainerDied","Data":"7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719"} Sep 17 22:00:41.554333 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.553993 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-985dbf6b7-dsmhs" event={"ID":"92a73798-b21a-4884-b5bc-e215a1caeea3","Type":"ContainerDied","Data":"e018bd6fcadad65d46bfbdc1c5b907146528cb291ce022ecf48434834ece7ba0"} Sep 17 22:00:41.554333 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.554025 2568 scope.go:117] "RemoveContainer" containerID="7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719" Sep 17 22:00:41.554333 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.554202 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-985dbf6b7-dsmhs" Sep 17 22:00:41.572844 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.572713 2568 scope.go:117] "RemoveContainer" containerID="7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719" Sep 17 22:00:41.573379 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:00:41.573264 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719\": container with ID starting with 7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719 not found: ID does not exist" containerID="7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719" Sep 17 22:00:41.573379 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.573305 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719"} err="failed to get container status \"7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719\": rpc error: code = NotFound desc = could not find container \"7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719\": container with ID starting with 7f5160fd017912445e8e21b1a090aa306f8c96dc35a9adb8bea974f587ddb719 not found: ID does not exist" Sep 17 22:00:41.582042 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.582019 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-985dbf6b7-dsmhs"] Sep 17 22:00:41.585661 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.585639 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-985dbf6b7-dsmhs"] Sep 17 22:00:41.863429 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:41.863358 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92a73798-b21a-4884-b5bc-e215a1caeea3" path="/var/lib/kubelet/pods/92a73798-b21a-4884-b5bc-e215a1caeea3/volumes" Sep 17 22:00:43.422365 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:43.422333 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-88wh9" Sep 17 22:00:45.116230 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:45.116198 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:00:45.120196 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:00:45.120174 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-89684b496-x6d6t" Sep 17 22:01:07.007572 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:01:07.007530 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:01:07.028271 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:01:07.028242 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:01:07.676874 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:01:07.676848 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 22:01:40.819180 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:01:40.819087 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f67d9cbb-m5vcp"] Sep 17 22:02:05.838798 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:05.838755 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86f67d9cbb-m5vcp" podUID="5a57658d-262b-4e56-90ca-f36f39095804" containerName="console" containerID="cri-o://e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7" gracePeriod=15 Sep 17 22:02:06.071880 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.071852 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:02:06.203810 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.203731 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-console-config\") pod \"5a57658d-262b-4e56-90ca-f36f39095804\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " Sep 17 22:02:06.203810 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.203763 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-serving-cert\") pod \"5a57658d-262b-4e56-90ca-f36f39095804\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " Sep 17 22:02:06.203810 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.203801 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-service-ca\") pod \"5a57658d-262b-4e56-90ca-f36f39095804\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " Sep 17 22:02:06.204075 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.203833 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-trusted-ca-bundle\") pod \"5a57658d-262b-4e56-90ca-f36f39095804\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " Sep 17 22:02:06.204075 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.203866 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjmr9\" (UniqueName: \"kubernetes.io/projected/5a57658d-262b-4e56-90ca-f36f39095804-kube-api-access-qjmr9\") pod \"5a57658d-262b-4e56-90ca-f36f39095804\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " Sep 17 22:02:06.204075 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.203944 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-oauth-serving-cert\") pod \"5a57658d-262b-4e56-90ca-f36f39095804\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " Sep 17 22:02:06.204075 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.203982 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-oauth-config\") pod \"5a57658d-262b-4e56-90ca-f36f39095804\" (UID: \"5a57658d-262b-4e56-90ca-f36f39095804\") " Sep 17 22:02:06.204258 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.204222 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-console-config" (OuterVolumeSpecName: "console-config") pod "5a57658d-262b-4e56-90ca-f36f39095804" (UID: "5a57658d-262b-4e56-90ca-f36f39095804"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:02:06.204392 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.204363 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a57658d-262b-4e56-90ca-f36f39095804" (UID: "5a57658d-262b-4e56-90ca-f36f39095804"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:02:06.204480 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.204433 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a57658d-262b-4e56-90ca-f36f39095804" (UID: "5a57658d-262b-4e56-90ca-f36f39095804"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:02:06.204480 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.204452 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a57658d-262b-4e56-90ca-f36f39095804" (UID: "5a57658d-262b-4e56-90ca-f36f39095804"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:02:06.206229 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.206200 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a57658d-262b-4e56-90ca-f36f39095804" (UID: "5a57658d-262b-4e56-90ca-f36f39095804"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:02:06.206229 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.206199 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a57658d-262b-4e56-90ca-f36f39095804-kube-api-access-qjmr9" (OuterVolumeSpecName: "kube-api-access-qjmr9") pod "5a57658d-262b-4e56-90ca-f36f39095804" (UID: "5a57658d-262b-4e56-90ca-f36f39095804"). InnerVolumeSpecName "kube-api-access-qjmr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:02:06.206368 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.206259 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a57658d-262b-4e56-90ca-f36f39095804" (UID: "5a57658d-262b-4e56-90ca-f36f39095804"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:02:06.304860 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.304816 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjmr9\" (UniqueName: \"kubernetes.io/projected/5a57658d-262b-4e56-90ca-f36f39095804-kube-api-access-qjmr9\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:02:06.304860 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.304854 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-oauth-serving-cert\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:02:06.304860 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.304865 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-oauth-config\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:02:06.304860 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.304874 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-console-config\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:02:06.305138 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.304883 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a57658d-262b-4e56-90ca-f36f39095804-console-serving-cert\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:02:06.305138 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.304891 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-service-ca\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:02:06.305138 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.304901 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a57658d-262b-4e56-90ca-f36f39095804-trusted-ca-bundle\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:02:06.900681 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.900643 2568 generic.go:356] "Generic (PLEG): container finished" podID="5a57658d-262b-4e56-90ca-f36f39095804" containerID="e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7" exitCode=0 Sep 17 22:02:06.900681 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.900684 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f67d9cbb-m5vcp" Sep 17 22:02:06.901176 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.900721 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f67d9cbb-m5vcp" event={"ID":"5a57658d-262b-4e56-90ca-f36f39095804","Type":"ContainerDied","Data":"e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7"} Sep 17 22:02:06.901176 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.900770 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f67d9cbb-m5vcp" event={"ID":"5a57658d-262b-4e56-90ca-f36f39095804","Type":"ContainerDied","Data":"2157b81d6d52e46d382061c98bed653ee7ba01ccbde8b20fbadc5393e61fbe6b"} Sep 17 22:02:06.901176 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.900790 2568 scope.go:117] "RemoveContainer" containerID="e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7" Sep 17 22:02:06.909733 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.909714 2568 scope.go:117] "RemoveContainer" containerID="e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7" Sep 17 22:02:06.910047 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:02:06.910026 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7\": container with ID starting with e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7 not found: ID does not exist" containerID="e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7" Sep 17 22:02:06.910139 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.910052 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7"} err="failed to get container status \"e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7\": rpc error: code = NotFound desc = could not find container \"e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7\": container with ID starting with e08553c9959d1570637c68e1053fa53001b8d037a2932512e9a7fe2898ec89c7 not found: ID does not exist" Sep 17 22:02:06.920951 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.920929 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f67d9cbb-m5vcp"] Sep 17 22:02:06.926591 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:06.926572 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f67d9cbb-m5vcp"] Sep 17 22:02:07.861523 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:02:07.861487 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a57658d-262b-4e56-90ca-f36f39095804" path="/var/lib/kubelet/pods/5a57658d-262b-4e56-90ca-f36f39095804/volumes" Sep 17 22:03:59.686191 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:03:59.686159 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:03:59.687103 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:03:59.687081 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:03:59.689641 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:03:59.689622 2568 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 22:06:19.474766 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.474689 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r526q"] Sep 17 22:06:19.475202 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.475047 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a73798-b21a-4884-b5bc-e215a1caeea3" containerName="console" Sep 17 22:06:19.475202 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.475060 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a73798-b21a-4884-b5bc-e215a1caeea3" containerName="console" Sep 17 22:06:19.475202 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.475082 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a57658d-262b-4e56-90ca-f36f39095804" containerName="console" Sep 17 22:06:19.475202 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.475087 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a57658d-262b-4e56-90ca-f36f39095804" containerName="console" Sep 17 22:06:19.475202 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.475141 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a73798-b21a-4884-b5bc-e215a1caeea3" containerName="console" Sep 17 22:06:19.475202 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.475149 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a57658d-262b-4e56-90ca-f36f39095804" containerName="console" Sep 17 22:06:19.477308 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.477292 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:19.480083 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.480057 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 22:06:19.480215 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.480140 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 22:06:19.480841 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.480827 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vfpb6\"" Sep 17 22:06:19.486956 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.486934 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r526q"] Sep 17 22:06:19.551453 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.551424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77c5769e-e6da-4ad4-b20a-45881b5d3891-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r526q\" (UID: \"77c5769e-e6da-4ad4-b20a-45881b5d3891\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:19.551453 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.551458 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssvvm\" (UniqueName: \"kubernetes.io/projected/77c5769e-e6da-4ad4-b20a-45881b5d3891-kube-api-access-ssvvm\") pod \"cert-manager-webhook-6486ffd997-r526q\" (UID: \"77c5769e-e6da-4ad4-b20a-45881b5d3891\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:19.652350 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.652311 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77c5769e-e6da-4ad4-b20a-45881b5d3891-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r526q\" (UID: \"77c5769e-e6da-4ad4-b20a-45881b5d3891\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:19.652350 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.652355 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssvvm\" (UniqueName: \"kubernetes.io/projected/77c5769e-e6da-4ad4-b20a-45881b5d3891-kube-api-access-ssvvm\") pod \"cert-manager-webhook-6486ffd997-r526q\" (UID: \"77c5769e-e6da-4ad4-b20a-45881b5d3891\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:19.661003 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.660973 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77c5769e-e6da-4ad4-b20a-45881b5d3891-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r526q\" (UID: \"77c5769e-e6da-4ad4-b20a-45881b5d3891\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:19.661117 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.661036 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssvvm\" (UniqueName: \"kubernetes.io/projected/77c5769e-e6da-4ad4-b20a-45881b5d3891-kube-api-access-ssvvm\") pod \"cert-manager-webhook-6486ffd997-r526q\" (UID: \"77c5769e-e6da-4ad4-b20a-45881b5d3891\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:19.680469 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.680443 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l6swc"] Sep 17 22:06:19.683020 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.683006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" Sep 17 22:06:19.685744 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.685724 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-82sgk\"" Sep 17 22:06:19.695580 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.695557 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l6swc"] Sep 17 22:06:19.753758 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.753674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46dcfa1e-076e-478b-a66d-e2967939eac0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l6swc\" (UID: \"46dcfa1e-076e-478b-a66d-e2967939eac0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" Sep 17 22:06:19.753758 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.753733 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wmv2\" (UniqueName: \"kubernetes.io/projected/46dcfa1e-076e-478b-a66d-e2967939eac0-kube-api-access-4wmv2\") pod \"cert-manager-cainjector-559cdd8c87-l6swc\" (UID: \"46dcfa1e-076e-478b-a66d-e2967939eac0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" Sep 17 22:06:19.797628 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.797597 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:19.854731 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.854653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46dcfa1e-076e-478b-a66d-e2967939eac0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l6swc\" (UID: \"46dcfa1e-076e-478b-a66d-e2967939eac0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" Sep 17 22:06:19.854874 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.854751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wmv2\" (UniqueName: \"kubernetes.io/projected/46dcfa1e-076e-478b-a66d-e2967939eac0-kube-api-access-4wmv2\") pod \"cert-manager-cainjector-559cdd8c87-l6swc\" (UID: \"46dcfa1e-076e-478b-a66d-e2967939eac0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" Sep 17 22:06:19.869058 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.869027 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wmv2\" (UniqueName: \"kubernetes.io/projected/46dcfa1e-076e-478b-a66d-e2967939eac0-kube-api-access-4wmv2\") pod \"cert-manager-cainjector-559cdd8c87-l6swc\" (UID: \"46dcfa1e-076e-478b-a66d-e2967939eac0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" Sep 17 22:06:19.869594 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.869542 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46dcfa1e-076e-478b-a66d-e2967939eac0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l6swc\" (UID: \"46dcfa1e-076e-478b-a66d-e2967939eac0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" Sep 17 22:06:19.992090 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:19.992064 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" Sep 17 22:06:20.072417 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:20.072391 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r526q"] Sep 17 22:06:20.075260 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:06:20.075234 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77c5769e_e6da_4ad4_b20a_45881b5d3891.slice/crio-540bff80472a138dc59c635c20785d96d2c5af370d6a2145f958850e52f0b624 WatchSource:0}: Error finding container 540bff80472a138dc59c635c20785d96d2c5af370d6a2145f958850e52f0b624: Status 404 returned error can't find the container with id 540bff80472a138dc59c635c20785d96d2c5af370d6a2145f958850e52f0b624 Sep 17 22:06:20.077357 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:20.077342 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 22:06:20.260717 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:20.260696 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l6swc"] Sep 17 22:06:20.262825 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:06:20.262796 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46dcfa1e_076e_478b_a66d_e2967939eac0.slice/crio-8080f07da4a2b82de891a6b4cb3fd25d06c94a4a085c60211a74fd996abf64ca WatchSource:0}: Error finding container 8080f07da4a2b82de891a6b4cb3fd25d06c94a4a085c60211a74fd996abf64ca: Status 404 returned error can't find the container with id 8080f07da4a2b82de891a6b4cb3fd25d06c94a4a085c60211a74fd996abf64ca Sep 17 22:06:20.910563 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:20.910521 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" event={"ID":"77c5769e-e6da-4ad4-b20a-45881b5d3891","Type":"ContainerStarted","Data":"540bff80472a138dc59c635c20785d96d2c5af370d6a2145f958850e52f0b624"} Sep 17 22:06:20.912895 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:20.912854 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" event={"ID":"46dcfa1e-076e-478b-a66d-e2967939eac0","Type":"ContainerStarted","Data":"8080f07da4a2b82de891a6b4cb3fd25d06c94a4a085c60211a74fd996abf64ca"} Sep 17 22:06:23.929900 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:23.929789 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" event={"ID":"77c5769e-e6da-4ad4-b20a-45881b5d3891","Type":"ContainerStarted","Data":"28ed126521601fdc327b6d411743a790b37a5869b8be04644af92e86cbb25f62"} Sep 17 22:06:23.930345 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:23.929949 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:23.931442 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:23.931419 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" event={"ID":"46dcfa1e-076e-478b-a66d-e2967939eac0","Type":"ContainerStarted","Data":"d10d4b55e890d9353cc60e6f6673501ab4cc480b37f7502b1953066467f29114"} Sep 17 22:06:23.948275 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:23.948226 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" podStartSLOduration=1.4524558920000001 podStartE2EDuration="4.9482115s" totalImagesPullingTime="3.495755608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:06:23.946429917 +0000 UTC m=+446.297636562" watchObservedRunningTime="2026-09-17 22:06:23.9482115 +0000 UTC m=+446.299418144" Sep 17 22:06:23.979770 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:23.979718 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l6swc" podStartSLOduration=1.656284995 podStartE2EDuration="4.979700764s" totalImagesPullingTime="3.323415769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:06:23.978953584 +0000 UTC m=+446.330160229" watchObservedRunningTime="2026-09-17 22:06:23.979700764 +0000 UTC m=+446.330907407" Sep 17 22:06:29.937695 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:29.937661 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r526q" Sep 17 22:06:35.529497 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.529458 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v"] Sep 17 22:06:35.535022 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.534998 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" Sep 17 22:06:35.537681 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.537657 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 22:06:35.538454 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.538436 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 22:06:35.538454 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.538445 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dczx5\"" Sep 17 22:06:35.540849 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.540829 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v"] Sep 17 22:06:35.686872 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.686840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f92dd0-f48e-4686-8e28-8888d3ed94ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nck9v\" (UID: \"12f92dd0-f48e-4686-8e28-8888d3ed94ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" Sep 17 22:06:35.687063 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.686884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfwm2\" (UniqueName: \"kubernetes.io/projected/12f92dd0-f48e-4686-8e28-8888d3ed94ec-kube-api-access-xfwm2\") pod \"openshift-lws-operator-fd8ccff4c-nck9v\" (UID: \"12f92dd0-f48e-4686-8e28-8888d3ed94ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" Sep 17 22:06:35.787671 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.787585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f92dd0-f48e-4686-8e28-8888d3ed94ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nck9v\" (UID: \"12f92dd0-f48e-4686-8e28-8888d3ed94ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" Sep 17 22:06:35.787671 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.787634 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfwm2\" (UniqueName: \"kubernetes.io/projected/12f92dd0-f48e-4686-8e28-8888d3ed94ec-kube-api-access-xfwm2\") pod \"openshift-lws-operator-fd8ccff4c-nck9v\" (UID: \"12f92dd0-f48e-4686-8e28-8888d3ed94ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" Sep 17 22:06:35.788058 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.788039 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f92dd0-f48e-4686-8e28-8888d3ed94ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nck9v\" (UID: \"12f92dd0-f48e-4686-8e28-8888d3ed94ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" Sep 17 22:06:35.796003 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.795968 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfwm2\" (UniqueName: \"kubernetes.io/projected/12f92dd0-f48e-4686-8e28-8888d3ed94ec-kube-api-access-xfwm2\") pod \"openshift-lws-operator-fd8ccff4c-nck9v\" (UID: \"12f92dd0-f48e-4686-8e28-8888d3ed94ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" Sep 17 22:06:35.845857 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:35.845827 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" Sep 17 22:06:36.116545 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:36.116517 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v"] Sep 17 22:06:36.118838 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:06:36.118807 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12f92dd0_f48e_4686_8e28_8888d3ed94ec.slice/crio-7e0828030bb5a494a97f134b58195a4a11767babd684dac3519361ca7fc8878d WatchSource:0}: Error finding container 7e0828030bb5a494a97f134b58195a4a11767babd684dac3519361ca7fc8878d: Status 404 returned error can't find the container with id 7e0828030bb5a494a97f134b58195a4a11767babd684dac3519361ca7fc8878d Sep 17 22:06:36.990460 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:36.990418 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" event={"ID":"12f92dd0-f48e-4686-8e28-8888d3ed94ec","Type":"ContainerStarted","Data":"7e0828030bb5a494a97f134b58195a4a11767babd684dac3519361ca7fc8878d"} Sep 17 22:06:39.001876 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:39.001835 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" event={"ID":"12f92dd0-f48e-4686-8e28-8888d3ed94ec","Type":"ContainerStarted","Data":"ae0a61b84987e0d14400e4d863c03992346f64d6ef3c44a2176fb1e1d72dfde2"} Sep 17 22:06:39.034959 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:39.034881 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nck9v" podStartSLOduration=1.840818834 podStartE2EDuration="4.034864057s" totalImagesPullingTime="2.194045223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:06:39.033657529 +0000 UTC m=+461.384864176" watchObservedRunningTime="2026-09-17 22:06:39.034864057 +0000 UTC m=+461.386070701" Sep 17 22:06:48.896146 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.896110 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd"] Sep 17 22:06:48.902353 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.902331 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:48.905597 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.905566 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 17 22:06:48.906753 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.906722 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zt8ks\"" Sep 17 22:06:48.906876 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.906755 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 17 22:06:48.906876 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.906755 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 17 22:06:48.910189 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.910168 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd"] Sep 17 22:06:48.995633 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.995595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-metrics-cert\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:48.995816 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.995645 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-cert\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:48.995816 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.995673 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhwdw\" (UniqueName: \"kubernetes.io/projected/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-kube-api-access-nhwdw\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:48.995816 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:48.995693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-manager-config\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.096312 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.096281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-cert\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.096312 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.096319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhwdw\" (UniqueName: \"kubernetes.io/projected/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-kube-api-access-nhwdw\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.096580 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.096337 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-manager-config\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.096580 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.096393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-metrics-cert\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.097063 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.097044 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-manager-config\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.098994 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.098964 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-metrics-cert\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.099168 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.099150 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-cert\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.109904 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.109881 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhwdw\" (UniqueName: \"kubernetes.io/projected/d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6-kube-api-access-nhwdw\") pod \"lws-controller-manager-65d86c4f4c-hcgsd\" (UID: \"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6\") " pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.213024 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.212991 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:49.490779 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:49.490753 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd"] Sep 17 22:06:49.493344 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:06:49.493317 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99c8776_a4ca_4d10_8cfb_1978c7bb1ad6.slice/crio-0165e47ae77327a8a7952056f417cbb753f6f69ea1fe79ffb29d367ed5c8adec WatchSource:0}: Error finding container 0165e47ae77327a8a7952056f417cbb753f6f69ea1fe79ffb29d367ed5c8adec: Status 404 returned error can't find the container with id 0165e47ae77327a8a7952056f417cbb753f6f69ea1fe79ffb29d367ed5c8adec Sep 17 22:06:50.049870 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:50.049832 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" event={"ID":"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6","Type":"ContainerStarted","Data":"0165e47ae77327a8a7952056f417cbb753f6f69ea1fe79ffb29d367ed5c8adec"} Sep 17 22:06:52.061717 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:52.061674 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" event={"ID":"d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6","Type":"ContainerStarted","Data":"5c783476b103fff793a717f4c5e211572aeb3e794dd1b2d8c7129afc4dbe77d5"} Sep 17 22:06:52.062190 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:52.061809 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:06:52.078366 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:06:52.078306 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" podStartSLOduration=2.055511601 podStartE2EDuration="4.078290362s" totalImagesPullingTime="2.022778761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:06:52.07825195 +0000 UTC m=+474.429458593" watchObservedRunningTime="2026-09-17 22:06:52.078290362 +0000 UTC m=+474.429496990" Sep 17 22:07:03.068244 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:03.068213 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65d86c4f4c-hcgsd" Sep 17 22:07:21.199748 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.199712 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw"] Sep 17 22:07:21.202575 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.202546 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" Sep 17 22:07:21.205443 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.205421 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 17 22:07:21.205557 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.205440 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 22:07:21.206787 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.206768 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-k4pt7\"" Sep 17 22:07:21.206787 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.206781 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 22:07:21.215090 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.215068 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw"] Sep 17 22:07:21.271218 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.271185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh5cd\" (UniqueName: \"kubernetes.io/projected/77990297-74f3-4fd8-9ad6-9587805a0c93-kube-api-access-vh5cd\") pod \"dns-operator-controller-manager-65dc8f76f5-h7vrw\" (UID: \"77990297-74f3-4fd8-9ad6-9587805a0c93\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" Sep 17 22:07:21.372165 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.372124 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh5cd\" (UniqueName: \"kubernetes.io/projected/77990297-74f3-4fd8-9ad6-9587805a0c93-kube-api-access-vh5cd\") pod \"dns-operator-controller-manager-65dc8f76f5-h7vrw\" (UID: \"77990297-74f3-4fd8-9ad6-9587805a0c93\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" Sep 17 22:07:21.390043 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.390013 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh5cd\" (UniqueName: \"kubernetes.io/projected/77990297-74f3-4fd8-9ad6-9587805a0c93-kube-api-access-vh5cd\") pod \"dns-operator-controller-manager-65dc8f76f5-h7vrw\" (UID: \"77990297-74f3-4fd8-9ad6-9587805a0c93\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" Sep 17 22:07:21.516222 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.516167 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" Sep 17 22:07:21.794239 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:21.794162 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw"] Sep 17 22:07:21.797955 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:07:21.797926 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77990297_74f3_4fd8_9ad6_9587805a0c93.slice/crio-71a196022dc773984f33bfdc08d48ba1fc05b664f8b855a4d1cc4334a3d8c8bf WatchSource:0}: Error finding container 71a196022dc773984f33bfdc08d48ba1fc05b664f8b855a4d1cc4334a3d8c8bf: Status 404 returned error can't find the container with id 71a196022dc773984f33bfdc08d48ba1fc05b664f8b855a4d1cc4334a3d8c8bf Sep 17 22:07:22.189544 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:22.189457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" event={"ID":"77990297-74f3-4fd8-9ad6-9587805a0c93","Type":"ContainerStarted","Data":"71a196022dc773984f33bfdc08d48ba1fc05b664f8b855a4d1cc4334a3d8c8bf"} Sep 17 22:07:25.209513 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:25.209465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" event={"ID":"77990297-74f3-4fd8-9ad6-9587805a0c93","Type":"ContainerStarted","Data":"f18be94519dd5370e607dc6524cb328ffb95a220fd6066ad82cb78220ea8627e"} Sep 17 22:07:25.209951 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:25.209626 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" Sep 17 22:07:25.239828 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:25.239775 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" podStartSLOduration=1.366480693 podStartE2EDuration="4.239759886s" totalImagesPullingTime="2.873279193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:07:25.237999204 +0000 UTC m=+507.589205863" watchObservedRunningTime="2026-09-17 22:07:25.239759886 +0000 UTC m=+507.590966531" Sep 17 22:07:26.083523 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.083487 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c"] Sep 17 22:07:26.086991 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.086973 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" Sep 17 22:07:26.089554 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.089534 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4vz8p\"" Sep 17 22:07:26.097252 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.097233 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c"] Sep 17 22:07:26.219443 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.219411 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wmm8\" (UniqueName: \"kubernetes.io/projected/476c54c3-f994-4c73-a29b-c693e1a50f8e-kube-api-access-6wmm8\") pod \"limitador-operator-controller-manager-5ffb4b4ccb-drw2c\" (UID: \"476c54c3-f994-4c73-a29b-c693e1a50f8e\") " pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" Sep 17 22:07:26.320168 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.320130 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wmm8\" (UniqueName: \"kubernetes.io/projected/476c54c3-f994-4c73-a29b-c693e1a50f8e-kube-api-access-6wmm8\") pod \"limitador-operator-controller-manager-5ffb4b4ccb-drw2c\" (UID: \"476c54c3-f994-4c73-a29b-c693e1a50f8e\") " pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" Sep 17 22:07:26.331122 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.331087 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wmm8\" (UniqueName: \"kubernetes.io/projected/476c54c3-f994-4c73-a29b-c693e1a50f8e-kube-api-access-6wmm8\") pod \"limitador-operator-controller-manager-5ffb4b4ccb-drw2c\" (UID: \"476c54c3-f994-4c73-a29b-c693e1a50f8e\") " pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" Sep 17 22:07:26.398100 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.398015 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" Sep 17 22:07:26.680377 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:26.680351 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c"] Sep 17 22:07:26.682347 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:07:26.682318 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476c54c3_f994_4c73_a29b_c693e1a50f8e.slice/crio-93061d0bfc0640802d8a5e32587414ce7ceab43a15ef414cfb8fe51ee412b80c WatchSource:0}: Error finding container 93061d0bfc0640802d8a5e32587414ce7ceab43a15ef414cfb8fe51ee412b80c: Status 404 returned error can't find the container with id 93061d0bfc0640802d8a5e32587414ce7ceab43a15ef414cfb8fe51ee412b80c Sep 17 22:07:27.222759 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:27.222725 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" event={"ID":"476c54c3-f994-4c73-a29b-c693e1a50f8e","Type":"ContainerStarted","Data":"93061d0bfc0640802d8a5e32587414ce7ceab43a15ef414cfb8fe51ee412b80c"} Sep 17 22:07:29.233403 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:29.233368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" event={"ID":"476c54c3-f994-4c73-a29b-c693e1a50f8e","Type":"ContainerStarted","Data":"dc75cb74b55178f4855fa5cec0f2c9bc69ebcf7c8c7d8731c4b6f0368ce9be89"} Sep 17 22:07:29.233880 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:29.233522 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" Sep 17 22:07:29.251365 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:29.251304 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" podStartSLOduration=1.173391558 podStartE2EDuration="3.251287892s" totalImagesPullingTime="2.077896334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:07:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:07:29.249668845 +0000 UTC m=+511.600875489" watchObservedRunningTime="2026-09-17 22:07:29.251287892 +0000 UTC m=+511.602494536" Sep 17 22:07:36.217206 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:36.217174 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-h7vrw" Sep 17 22:07:40.240738 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:07:40.240658 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5ffb4b4ccb-drw2c" Sep 17 22:08:08.779753 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.779718 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bkrrs"] Sep 17 22:08:08.786760 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.786737 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:08.789190 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.789171 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 17 22:08:08.789315 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.789287 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z2qkm\"" Sep 17 22:08:08.793135 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.793098 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bkrrs"] Sep 17 22:08:08.875789 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.875733 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csfgd\" (UniqueName: \"kubernetes.io/projected/9796afe7-e59d-49aa-bfb1-17a507045406-kube-api-access-csfgd\") pod \"limitador-limitador-8588749977-bkrrs\" (UID: \"9796afe7-e59d-49aa-bfb1-17a507045406\") " pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:08.876022 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.875813 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9796afe7-e59d-49aa-bfb1-17a507045406-config-file\") pod \"limitador-limitador-8588749977-bkrrs\" (UID: \"9796afe7-e59d-49aa-bfb1-17a507045406\") " pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:08.877797 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.877774 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bkrrs"] Sep 17 22:08:08.976410 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.976374 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csfgd\" (UniqueName: \"kubernetes.io/projected/9796afe7-e59d-49aa-bfb1-17a507045406-kube-api-access-csfgd\") pod \"limitador-limitador-8588749977-bkrrs\" (UID: \"9796afe7-e59d-49aa-bfb1-17a507045406\") " pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:08.976410 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.976413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9796afe7-e59d-49aa-bfb1-17a507045406-config-file\") pod \"limitador-limitador-8588749977-bkrrs\" (UID: \"9796afe7-e59d-49aa-bfb1-17a507045406\") " pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:08.977021 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.977002 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9796afe7-e59d-49aa-bfb1-17a507045406-config-file\") pod \"limitador-limitador-8588749977-bkrrs\" (UID: \"9796afe7-e59d-49aa-bfb1-17a507045406\") " pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:08.986454 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:08.986432 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csfgd\" (UniqueName: \"kubernetes.io/projected/9796afe7-e59d-49aa-bfb1-17a507045406-kube-api-access-csfgd\") pod \"limitador-limitador-8588749977-bkrrs\" (UID: \"9796afe7-e59d-49aa-bfb1-17a507045406\") " pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:09.097950 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:09.097840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:09.369702 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:09.369677 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bkrrs"] Sep 17 22:08:09.371809 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:08:09.371783 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9796afe7_e59d_49aa_bfb1_17a507045406.slice/crio-021362e81288d60c73424df853c8560ba142b4ab9758b4554ba867f87d54ca27 WatchSource:0}: Error finding container 021362e81288d60c73424df853c8560ba142b4ab9758b4554ba867f87d54ca27: Status 404 returned error can't find the container with id 021362e81288d60c73424df853c8560ba142b4ab9758b4554ba867f87d54ca27 Sep 17 22:08:09.420583 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:09.420554 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" event={"ID":"9796afe7-e59d-49aa-bfb1-17a507045406","Type":"ContainerStarted","Data":"021362e81288d60c73424df853c8560ba142b4ab9758b4554ba867f87d54ca27"} Sep 17 22:08:11.431551 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:11.431520 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" event={"ID":"9796afe7-e59d-49aa-bfb1-17a507045406","Type":"ContainerStarted","Data":"66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42"} Sep 17 22:08:11.431954 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:11.431582 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:11.449762 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:11.449715 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" podStartSLOduration=2.127944445 podStartE2EDuration="3.449699246s" totalImagesPullingTime="1.321754801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:08:11.448150143 +0000 UTC m=+553.799356787" watchObservedRunningTime="2026-09-17 22:08:11.449699246 +0000 UTC m=+553.800905890" Sep 17 22:08:22.437276 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:22.437246 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:23.623804 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:23.623766 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bkrrs"] Sep 17 22:08:23.624245 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:23.623956 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" podUID="9796afe7-e59d-49aa-bfb1-17a507045406" containerName="limitador" containerID="cri-o://66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42" gracePeriod=30 Sep 17 22:08:24.170371 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.170347 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:24.315030 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.314994 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9796afe7-e59d-49aa-bfb1-17a507045406-config-file\") pod \"9796afe7-e59d-49aa-bfb1-17a507045406\" (UID: \"9796afe7-e59d-49aa-bfb1-17a507045406\") " Sep 17 22:08:24.315201 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.315044 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csfgd\" (UniqueName: \"kubernetes.io/projected/9796afe7-e59d-49aa-bfb1-17a507045406-kube-api-access-csfgd\") pod \"9796afe7-e59d-49aa-bfb1-17a507045406\" (UID: \"9796afe7-e59d-49aa-bfb1-17a507045406\") " Sep 17 22:08:24.315337 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.315313 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9796afe7-e59d-49aa-bfb1-17a507045406-config-file" (OuterVolumeSpecName: "config-file") pod "9796afe7-e59d-49aa-bfb1-17a507045406" (UID: "9796afe7-e59d-49aa-bfb1-17a507045406"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:08:24.317422 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.317393 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9796afe7-e59d-49aa-bfb1-17a507045406-kube-api-access-csfgd" (OuterVolumeSpecName: "kube-api-access-csfgd") pod "9796afe7-e59d-49aa-bfb1-17a507045406" (UID: "9796afe7-e59d-49aa-bfb1-17a507045406"). InnerVolumeSpecName "kube-api-access-csfgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:08:24.416073 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.416041 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9796afe7-e59d-49aa-bfb1-17a507045406-config-file\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:08:24.416073 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.416067 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csfgd\" (UniqueName: \"kubernetes.io/projected/9796afe7-e59d-49aa-bfb1-17a507045406-kube-api-access-csfgd\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:08:24.491491 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.491458 2568 generic.go:356] "Generic (PLEG): container finished" podID="9796afe7-e59d-49aa-bfb1-17a507045406" containerID="66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42" exitCode=0 Sep 17 22:08:24.491635 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.491504 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" Sep 17 22:08:24.491635 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.491536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" event={"ID":"9796afe7-e59d-49aa-bfb1-17a507045406","Type":"ContainerDied","Data":"66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42"} Sep 17 22:08:24.491635 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.491576 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-bkrrs" event={"ID":"9796afe7-e59d-49aa-bfb1-17a507045406","Type":"ContainerDied","Data":"021362e81288d60c73424df853c8560ba142b4ab9758b4554ba867f87d54ca27"} Sep 17 22:08:24.491635 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.491597 2568 scope.go:117] "RemoveContainer" containerID="66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42" Sep 17 22:08:24.500939 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.500895 2568 scope.go:117] "RemoveContainer" containerID="66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42" Sep 17 22:08:24.501249 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:08:24.501232 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42\": container with ID starting with 66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42 not found: ID does not exist" containerID="66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42" Sep 17 22:08:24.501294 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.501260 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42"} err="failed to get container status \"66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42\": rpc error: code = NotFound desc = could not find container \"66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42\": container with ID starting with 66f8e35152c0a2740570ba01f328df8ea6d436fd5fb17a0dba0d54eb53957c42 not found: ID does not exist" Sep 17 22:08:24.512776 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.512754 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bkrrs"] Sep 17 22:08:24.516304 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:24.516279 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-bkrrs"] Sep 17 22:08:25.863251 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:25.863221 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9796afe7-e59d-49aa-bfb1-17a507045406" path="/var/lib/kubelet/pods/9796afe7-e59d-49aa-bfb1-17a507045406/volumes" Sep 17 22:08:51.333127 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.333088 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx"] Sep 17 22:08:51.333572 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.333426 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9796afe7-e59d-49aa-bfb1-17a507045406" containerName="limitador" Sep 17 22:08:51.333572 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.333436 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9796afe7-e59d-49aa-bfb1-17a507045406" containerName="limitador" Sep 17 22:08:51.333572 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.333505 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9796afe7-e59d-49aa-bfb1-17a507045406" containerName="limitador" Sep 17 22:08:51.337165 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.337146 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.340053 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.340028 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 22:08:51.340195 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.340159 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 17 22:08:51.340195 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.340177 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 17 22:08:51.340381 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.340368 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q7nnf\"" Sep 17 22:08:51.340844 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.340826 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 22:08:51.340897 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.340857 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 17 22:08:51.341046 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.341030 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 17 22:08:51.350892 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.350865 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx"] Sep 17 22:08:51.457874 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.457838 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.458121 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.457884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk259\" (UniqueName: \"kubernetes.io/projected/aecba190-b5c8-440e-b18c-3f696ae64f0c-kube-api-access-bk259\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.458121 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.457963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.458121 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.457996 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.458121 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.458032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.458121 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.458050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aecba190-b5c8-440e-b18c-3f696ae64f0c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.458121 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.458069 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.558677 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.558638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.558849 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.558687 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.558849 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.558710 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aecba190-b5c8-440e-b18c-3f696ae64f0c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.558849 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.558742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.558849 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.558787 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.558849 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.558826 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk259\" (UniqueName: \"kubernetes.io/projected/aecba190-b5c8-440e-b18c-3f696ae64f0c-kube-api-access-bk259\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.559144 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.558858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.559539 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.559515 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.561416 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.561387 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.561416 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.561403 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.561751 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.561728 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aecba190-b5c8-440e-b18c-3f696ae64f0c-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.561831 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.561812 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.566711 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.566687 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aecba190-b5c8-440e-b18c-3f696ae64f0c-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.566882 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.566865 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk259\" (UniqueName: \"kubernetes.io/projected/aecba190-b5c8-440e-b18c-3f696ae64f0c-kube-api-access-bk259\") pod \"istiod-openshift-gateway-5677ccb49b-b7qpx\" (UID: \"aecba190-b5c8-440e-b18c-3f696ae64f0c\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.647077 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.647009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:51.921814 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:51.921791 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx"] Sep 17 22:08:51.924000 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:08:51.923970 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecba190_b5c8_440e_b18c_3f696ae64f0c.slice/crio-38b79c3ef273356aa14895f8a8c6fd4d3fe537361d1656f9fbfc32fee00f9bcd WatchSource:0}: Error finding container 38b79c3ef273356aa14895f8a8c6fd4d3fe537361d1656f9fbfc32fee00f9bcd: Status 404 returned error can't find the container with id 38b79c3ef273356aa14895f8a8c6fd4d3fe537361d1656f9fbfc32fee00f9bcd Sep 17 22:08:52.617422 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:52.617392 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" event={"ID":"aecba190-b5c8-440e-b18c-3f696ae64f0c","Type":"ContainerStarted","Data":"38b79c3ef273356aa14895f8a8c6fd4d3fe537361d1656f9fbfc32fee00f9bcd"} Sep 17 22:08:54.353889 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:54.353850 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 22:08:54.354186 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:54.353943 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 22:08:54.632414 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:54.632317 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" event={"ID":"aecba190-b5c8-440e-b18c-3f696ae64f0c","Type":"ContainerStarted","Data":"711046d544dc5126a292e391e9e8cbac13947b3088922710f36936361c13118b"} Sep 17 22:08:54.632414 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:54.632405 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:54.653766 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:54.653716 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" podStartSLOduration=1.226148816 podStartE2EDuration="3.653701613s" totalImagesPullingTime="2.427552797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:08:54.651536646 +0000 UTC m=+597.002743291" watchObservedRunningTime="2026-09-17 22:08:54.653701613 +0000 UTC m=+597.004908256" Sep 17 22:08:55.640610 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:55.640581 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-b7qpx" Sep 17 22:08:59.719378 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:59.719352 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:08:59.719943 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:08:59.719922 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:13:59.756332 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:13:59.756301 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:13:59.757359 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:13:59.757337 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:17:25.361850 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.361814 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p"] Sep 17 22:17:25.365889 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.365869 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.368797 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.368778 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-gw-ca-root-cert\"" Sep 17 22:17:25.368958 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.368941 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"router-gateway-1-openshift-default-dockercfg-djrzs\"" Sep 17 22:17:25.369538 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.369519 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"kube-root-ca.crt\"" Sep 17 22:17:25.369819 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.369801 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-gateway-section-name-propagation-94799d44\"/\"openshift-service-ca.crt\"" Sep 17 22:17:25.388033 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.388006 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p"] Sep 17 22:17:25.451553 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.451512 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.451811 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.451771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.451811 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.451808 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.452039 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.451840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.452039 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.451953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.452166 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.452037 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.452166 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.452077 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.452166 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.452145 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6gz\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-kube-api-access-rv6gz\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.452315 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.452210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553160 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553160 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553380 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553178 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553380 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553205 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553380 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553380 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553380 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553380 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6gz\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-kube-api-access-rv6gz\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553723 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553723 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553656 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-certs\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553723 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553683 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.553877 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.553816 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-credential-socket\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.554069 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.554045 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-data\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.554153 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.554130 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.555519 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.555499 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-envoy\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.555945 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.555926 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-podinfo\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.561374 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.561351 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-token\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.561841 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.561825 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6gz\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-kube-api-access-rv6gz\") pod \"router-gateway-1-openshift-default-7dcbd489bd-p2n8p\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.676625 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.676547 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:25.952050 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.952025 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p"] Sep 17 22:17:25.953731 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:17:25.953702 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b5c00a_6306_42a8_bffd_e3cd038adfe7.slice/crio-3e114630c910d3eecaacd571d12cf31a7c959eec05fcb236d9c5dc55f6bcb123 WatchSource:0}: Error finding container 3e114630c910d3eecaacd571d12cf31a7c959eec05fcb236d9c5dc55f6bcb123: Status 404 returned error can't find the container with id 3e114630c910d3eecaacd571d12cf31a7c959eec05fcb236d9c5dc55f6bcb123 Sep 17 22:17:25.955662 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:25.955644 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 22:17:26.035754 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:26.035720 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" event={"ID":"98b5c00a-6306-42a8-bffd-e3cd038adfe7","Type":"ContainerStarted","Data":"3e114630c910d3eecaacd571d12cf31a7c959eec05fcb236d9c5dc55f6bcb123"} Sep 17 22:17:28.863384 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:28.863351 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 22:17:28.863617 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:28.863425 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 22:17:28.863617 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:28.863454 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"} Sep 17 22:17:29.053584 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:29.053554 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" event={"ID":"98b5c00a-6306-42a8-bffd-e3cd038adfe7","Type":"ContainerStarted","Data":"cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977"} Sep 17 22:17:29.073049 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:29.072972 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" podStartSLOduration=1.165617137 podStartE2EDuration="4.072951024s" totalImagesPullingTime="2.907333887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:17:29.07167138 +0000 UTC m=+1111.422878023" watchObservedRunningTime="2026-09-17 22:17:29.072951024 +0000 UTC m=+1111.424157669" Sep 17 22:17:29.676852 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:29.676815 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:29.681887 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:29.681863 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:30.058531 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:30.058496 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:30.059362 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:30.059344 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:48.736748 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:48.736711 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p"] Sep 17 22:17:48.737401 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:48.736902 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" podUID="98b5c00a-6306-42a8-bffd-e3cd038adfe7" containerName="istio-proxy" containerID="cri-o://cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977" gracePeriod=30 Sep 17 22:17:50.585286 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.585255 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:50.696558 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696518 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv6gz\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-kube-api-access-rv6gz\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.696558 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696563 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-socket\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.696795 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696593 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-token\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.696795 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696705 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-credential-socket\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.696795 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696780 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-envoy\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.697019 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696821 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-podinfo\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.697019 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696849 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istiod-ca-cert\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.697019 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696893 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-certs\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.697019 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696953 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-data\") pod \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\" (UID: \"98b5c00a-6306-42a8-bffd-e3cd038adfe7\") " Sep 17 22:17:50.697019 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696845 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 22:17:50.697402 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.696996 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 22:17:50.697402 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.697220 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 22:17:50.697402 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.697236 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 22:17:50.697402 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.697309 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-credential-socket\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:50.697402 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.697328 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istiod-ca-cert\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:50.697402 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.697341 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-certs\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:50.697402 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.697353 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-workload-socket\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:50.697402 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.697383 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 22:17:50.699106 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.699082 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-kube-api-access-rv6gz" (OuterVolumeSpecName: "kube-api-access-rv6gz") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "kube-api-access-rv6gz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:17:50.699232 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.699215 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Sep 17 22:17:50.699540 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.699522 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:17:50.699581 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.699523 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "98b5c00a-6306-42a8-bffd-e3cd038adfe7" (UID: "98b5c00a-6306-42a8-bffd-e3cd038adfe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 22:17:50.798219 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.798182 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-podinfo\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:50.798219 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.798212 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-data\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:50.798219 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.798222 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv6gz\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-kube-api-access-rv6gz\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:50.798456 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.798232 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-token\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:50.798456 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:50.798241 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/98b5c00a-6306-42a8-bffd-e3cd038adfe7-istio-envoy\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:17:51.163898 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.163856 2568 generic.go:356] "Generic (PLEG): container finished" podID="98b5c00a-6306-42a8-bffd-e3cd038adfe7" containerID="cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977" exitCode=0 Sep 17 22:17:51.163898 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.163900 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" event={"ID":"98b5c00a-6306-42a8-bffd-e3cd038adfe7","Type":"ContainerDied","Data":"cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977"} Sep 17 22:17:51.164190 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.163937 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" Sep 17 22:17:51.164190 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.163976 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p" event={"ID":"98b5c00a-6306-42a8-bffd-e3cd038adfe7","Type":"ContainerDied","Data":"3e114630c910d3eecaacd571d12cf31a7c959eec05fcb236d9c5dc55f6bcb123"} Sep 17 22:17:51.164190 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.163999 2568 scope.go:117] "RemoveContainer" containerID="cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977" Sep 17 22:17:51.173535 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.173517 2568 scope.go:117] "RemoveContainer" containerID="cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977" Sep 17 22:17:51.173808 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:17:51.173790 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977\": container with ID starting with cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977 not found: ID does not exist" containerID="cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977" Sep 17 22:17:51.173851 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.173818 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977"} err="failed to get container status \"cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977\": rpc error: code = NotFound desc = could not find container \"cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977\": container with ID starting with cf25dfe73cd7ca4241cb37ff79be001b54880188ba88a087cd37bc9da95db977 not found: ID does not exist" Sep 17 22:17:51.185851 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.185828 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p"] Sep 17 22:17:51.190083 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.190059 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-gateway-section-name-propagation-94799d44/router-gateway-1-openshift-default-7dcbd489bd-p2n8p"] Sep 17 22:17:51.862783 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:17:51.862750 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98b5c00a-6306-42a8-bffd-e3cd038adfe7" path="/var/lib/kubelet/pods/98b5c00a-6306-42a8-bffd-e3cd038adfe7/volumes" Sep 17 22:18:59.787322 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:18:59.787286 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:18:59.789789 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:18:59.789768 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:23:59.817160 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:23:59.817129 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:23:59.821867 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:23:59.821841 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:28:19.987087 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.987052 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc"] Sep 17 22:28:19.987550 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.987417 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98b5c00a-6306-42a8-bffd-e3cd038adfe7" containerName="istio-proxy" Sep 17 22:28:19.987550 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.987429 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="98b5c00a-6306-42a8-bffd-e3cd038adfe7" containerName="istio-proxy" Sep 17 22:28:19.987550 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.987496 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="98b5c00a-6306-42a8-bffd-e3cd038adfe7" containerName="istio-proxy" Sep 17 22:28:19.989646 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.989624 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:19.993564 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.993537 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs\"" Sep 17 22:28:19.993726 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.993577 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"kube-root-ca.crt\"" Sep 17 22:28:19.993726 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.993596 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa-dockercfg-mx8f7\"" Sep 17 22:28:19.993726 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.993603 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"openshift-service-ca.crt\"" Sep 17 22:28:19.994180 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:19.994155 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-84370a53\"/\"default-dockercfg-j7qlc\"" Sep 17 22:28:20.005165 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.005128 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc"] Sep 17 22:28:20.092750 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.092710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc\" (UID: \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:20.092750 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.092756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f74t5\" (UniqueName: \"kubernetes.io/projected/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-kube-api-access-f74t5\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc\" (UID: \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:20.193360 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.193317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc\" (UID: \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:20.193538 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.193366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f74t5\" (UniqueName: \"kubernetes.io/projected/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-kube-api-access-f74t5\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc\" (UID: \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:20.196084 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.196059 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-tls-certs\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc\" (UID: \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:20.201830 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.201799 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f74t5\" (UniqueName: \"kubernetes.io/projected/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-kube-api-access-f74t5\") pod \"llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc\" (UID: \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\") " pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:20.304153 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.304060 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:20.576119 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.576084 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc"] Sep 17 22:28:20.578443 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:28:20.578415 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce69d0d_3f21_43b7_9200_ec50b3785ce9.slice/crio-f53175eb6033853338a90ea67db15e5d8e599acafb8e88c40bac8a73e17ec36a WatchSource:0}: Error finding container f53175eb6033853338a90ea67db15e5d8e599acafb8e88c40bac8a73e17ec36a: Status 404 returned error can't find the container with id f53175eb6033853338a90ea67db15e5d8e599acafb8e88c40bac8a73e17ec36a Sep 17 22:28:20.580423 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:20.580403 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 22:28:21.104972 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:21.104937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" event={"ID":"9ce69d0d-3f21-43b7-9200-ec50b3785ce9","Type":"ContainerStarted","Data":"f53175eb6033853338a90ea67db15e5d8e599acafb8e88c40bac8a73e17ec36a"} Sep 17 22:28:23.116947 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:23.116825 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" event={"ID":"9ce69d0d-3f21-43b7-9200-ec50b3785ce9","Type":"ContainerStarted","Data":"c599d0e0a404f14b032d7c6d52393448af79318646386706c6f6de7ad5e63e6d"} Sep 17 22:28:23.116947 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:23.116888 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:23.134009 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:23.133958 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" podStartSLOduration=1.846495422 podStartE2EDuration="4.133940514s" totalImagesPullingTime="2.287445092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:28:23.132007904 +0000 UTC m=+1765.483214548" watchObservedRunningTime="2026-09-17 22:28:23.133940514 +0000 UTC m=+1765.485147161" Sep 17 22:28:54.123399 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:54.123362 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:28:59.847240 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:59.847212 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:28:59.852981 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:28:59.852960 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:29:07.392459 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:07.392426 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc"] Sep 17 22:29:14.123455 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:14.123407 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:29:22.412191 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:22.412125 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerName="main" containerID="cri-o://c599d0e0a404f14b032d7c6d52393448af79318646386706c6f6de7ad5e63e6d" gracePeriod=45 Sep 17 22:29:24.123522 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:24.123485 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:29:34.123393 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:34.123354 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:29:34.123935 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:34.123493 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:29:44.123501 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:44.123454 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:29:52.543942 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.543880 2568 generic.go:356] "Generic (PLEG): container finished" podID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerID="c599d0e0a404f14b032d7c6d52393448af79318646386706c6f6de7ad5e63e6d" exitCode=0 Sep 17 22:29:52.544334 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.543966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" event={"ID":"9ce69d0d-3f21-43b7-9200-ec50b3785ce9","Type":"ContainerDied","Data":"c599d0e0a404f14b032d7c6d52393448af79318646386706c6f6de7ad5e63e6d"} Sep 17 22:29:52.667335 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.667311 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:29:52.725032 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.724994 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f74t5\" (UniqueName: \"kubernetes.io/projected/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-kube-api-access-f74t5\") pod \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\" (UID: \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\") " Sep 17 22:29:52.725241 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.725094 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-tls-certs\") pod \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\" (UID: \"9ce69d0d-3f21-43b7-9200-ec50b3785ce9\") " Sep 17 22:29:52.727564 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.727531 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-kube-api-access-f74t5" (OuterVolumeSpecName: "kube-api-access-f74t5") pod "9ce69d0d-3f21-43b7-9200-ec50b3785ce9" (UID: "9ce69d0d-3f21-43b7-9200-ec50b3785ce9"). InnerVolumeSpecName "kube-api-access-f74t5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:29:52.727564 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.727545 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ce69d0d-3f21-43b7-9200-ec50b3785ce9" (UID: "9ce69d0d-3f21-43b7-9200-ec50b3785ce9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:29:52.826011 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.825970 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-tls-certs\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:29:52.826011 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:52.826000 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f74t5\" (UniqueName: \"kubernetes.io/projected/9ce69d0d-3f21-43b7-9200-ec50b3785ce9-kube-api-access-f74t5\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:29:53.550328 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:53.550298 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" Sep 17 22:29:53.550328 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:53.550326 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc" event={"ID":"9ce69d0d-3f21-43b7-9200-ec50b3785ce9","Type":"ContainerDied","Data":"f53175eb6033853338a90ea67db15e5d8e599acafb8e88c40bac8a73e17ec36a"} Sep 17 22:29:53.550829 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:53.550387 2568 scope.go:117] "RemoveContainer" containerID="c599d0e0a404f14b032d7c6d52393448af79318646386706c6f6de7ad5e63e6d" Sep 17 22:29:53.572405 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:53.572371 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc"] Sep 17 22:29:53.575971 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:53.575944 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-84370a53/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schemrflc"] Sep 17 22:29:53.863438 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:29:53.863357 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" path="/var/lib/kubelet/pods/9ce69d0d-3f21-43b7-9200-ec50b3785ce9/volumes" Sep 17 22:32:10.665934 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.665872 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg"] Sep 17 22:32:10.666479 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.666444 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerName="main" Sep 17 22:32:10.666479 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.666464 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerName="main" Sep 17 22:32:10.666596 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.666581 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce69d0d-3f21-43b7-9200-ec50b3785ce9" containerName="main" Sep 17 22:32:10.669987 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.669965 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:10.673737 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.673712 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"openshift-service-ca.crt\"" Sep 17 22:32:10.673892 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.673869 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa-dockercfg-jdsb2\"" Sep 17 22:32:10.673990 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.673902 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"kube-root-ca.crt\"" Sep 17 22:32:10.674049 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.674022 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"default-dockercfg-b2h2t\"" Sep 17 22:32:10.674152 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.674128 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-079cb970\"/\"llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs\"" Sep 17 22:32:10.678200 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.677954 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg"] Sep 17 22:32:10.743154 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.743119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg\" (UID: \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\") " pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:10.743318 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.743185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9prn\" (UniqueName: \"kubernetes.io/projected/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-kube-api-access-f9prn\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg\" (UID: \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\") " pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:10.844512 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.844469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg\" (UID: \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\") " pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:10.844692 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.844541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9prn\" (UniqueName: \"kubernetes.io/projected/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-kube-api-access-f9prn\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg\" (UID: \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\") " pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:10.847099 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.847081 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-tls-certs\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg\" (UID: \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\") " pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:10.853603 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.853578 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9prn\" (UniqueName: \"kubernetes.io/projected/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-kube-api-access-f9prn\") pod \"llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg\" (UID: \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\") " pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:10.982821 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:10.982780 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:11.255875 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:11.255848 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg"] Sep 17 22:32:11.258261 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:32:11.258236 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7cefe1_46fa_4629_96f1_1f9b1a413efc.slice/crio-ba246e5dc647f40fb08188ad5fc02af74c1f3de835bc0b14d1568b59ac492566 WatchSource:0}: Error finding container ba246e5dc647f40fb08188ad5fc02af74c1f3de835bc0b14d1568b59ac492566: Status 404 returned error can't find the container with id ba246e5dc647f40fb08188ad5fc02af74c1f3de835bc0b14d1568b59ac492566 Sep 17 22:32:12.201502 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:12.201468 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" event={"ID":"0c7cefe1-46fa-4629-96f1-1f9b1a413efc","Type":"ContainerStarted","Data":"22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b"} Sep 17 22:32:12.201935 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:12.201525 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" event={"ID":"0c7cefe1-46fa-4629-96f1-1f9b1a413efc","Type":"ContainerStarted","Data":"ba246e5dc647f40fb08188ad5fc02af74c1f3de835bc0b14d1568b59ac492566"} Sep 17 22:32:12.201935 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:12.201609 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:32:12.219747 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:12.219698 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" podStartSLOduration=2.219681748 podStartE2EDuration="2.219681748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:32:12.219333901 +0000 UTC m=+1994.570540546" watchObservedRunningTime="2026-09-17 22:32:12.219681748 +0000 UTC m=+1994.570888392" Sep 17 22:32:43.208594 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:32:43.208561 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:33:59.879098 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:33:59.879068 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:33:59.884788 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:33:59.884768 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:34:56.900544 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:34:56.900506 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg"] Sep 17 22:35:03.208987 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:03.208945 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:35:11.921085 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:11.921045 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerName="main" containerID="cri-o://22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b" gracePeriod=45 Sep 17 22:35:13.208306 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:13.208268 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:35:23.208002 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:23.207964 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:35:23.208549 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:23.208093 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:35:33.208500 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:33.208456 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:35:42.165598 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.165573 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:35:42.197696 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.197620 2568 generic.go:356] "Generic (PLEG): container finished" podID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerID="22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b" exitCode=0 Sep 17 22:35:42.197696 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.197667 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" Sep 17 22:35:42.197947 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.197709 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" event={"ID":"0c7cefe1-46fa-4629-96f1-1f9b1a413efc","Type":"ContainerDied","Data":"22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b"} Sep 17 22:35:42.197947 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.197758 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg" event={"ID":"0c7cefe1-46fa-4629-96f1-1f9b1a413efc","Type":"ContainerDied","Data":"ba246e5dc647f40fb08188ad5fc02af74c1f3de835bc0b14d1568b59ac492566"} Sep 17 22:35:42.197947 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.197783 2568 scope.go:117] "RemoveContainer" containerID="22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b" Sep 17 22:35:42.206292 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.206272 2568 scope.go:117] "RemoveContainer" containerID="22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b" Sep 17 22:35:42.206589 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:35:42.206569 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b\": container with ID starting with 22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b not found: ID does not exist" containerID="22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b" Sep 17 22:35:42.206589 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.206596 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b"} err="failed to get container status \"22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b\": rpc error: code = NotFound desc = could not find container \"22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b\": container with ID starting with 22af13276a543ced602444a5f87747c3c8f1e0dcd560acdf802cb339f005ab4b not found: ID does not exist" Sep 17 22:35:42.342302 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.342262 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9prn\" (UniqueName: \"kubernetes.io/projected/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-kube-api-access-f9prn\") pod \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\" (UID: \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\") " Sep 17 22:35:42.342462 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.342321 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-tls-certs\") pod \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\" (UID: \"0c7cefe1-46fa-4629-96f1-1f9b1a413efc\") " Sep 17 22:35:42.344646 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.344615 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0c7cefe1-46fa-4629-96f1-1f9b1a413efc" (UID: "0c7cefe1-46fa-4629-96f1-1f9b1a413efc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:35:42.344757 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.344678 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-kube-api-access-f9prn" (OuterVolumeSpecName: "kube-api-access-f9prn") pod "0c7cefe1-46fa-4629-96f1-1f9b1a413efc" (UID: "0c7cefe1-46fa-4629-96f1-1f9b1a413efc"). InnerVolumeSpecName "kube-api-access-f9prn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:35:42.442901 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.442852 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9prn\" (UniqueName: \"kubernetes.io/projected/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-kube-api-access-f9prn\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:35:42.442901 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.442893 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c7cefe1-46fa-4629-96f1-1f9b1a413efc-tls-certs\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:35:42.519122 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.519084 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg"] Sep 17 22:35:42.525302 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:42.525273 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-079cb970/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8pplg"] Sep 17 22:35:43.863241 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:35:43.863208 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" path="/var/lib/kubelet/pods/0c7cefe1-46fa-4629-96f1-1f9b1a413efc/volumes" Sep 17 22:38:08.106046 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.106014 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p"] Sep 17 22:38:08.106556 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.106529 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerName="main" Sep 17 22:38:08.106556 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.106549 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerName="main" Sep 17 22:38:08.106666 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.106655 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c7cefe1-46fa-4629-96f1-1f9b1a413efc" containerName="main" Sep 17 22:38:08.109648 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.109630 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.113258 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.113235 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa-dockercfg-n8hrp\"" Sep 17 22:38:08.113374 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.113235 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"kube-root-ca.crt\"" Sep 17 22:38:08.113374 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.113235 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"openshift-service-ca.crt\"" Sep 17 22:38:08.113374 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.113236 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"default-dockercfg-v6sqj\"" Sep 17 22:38:08.113534 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.113413 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-733055c7\"/\"llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs\"" Sep 17 22:38:08.118865 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.118843 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p"] Sep 17 22:38:08.188727 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.188695 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6rhv\" (UniqueName: \"kubernetes.io/projected/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-kube-api-access-l6rhv\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p\" (UID: \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.188894 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.188762 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p\" (UID: \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.289809 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.289774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6rhv\" (UniqueName: \"kubernetes.io/projected/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-kube-api-access-l6rhv\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p\" (UID: \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.290006 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.289852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p\" (UID: \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.292488 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.292462 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-tls-certs\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p\" (UID: \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.297870 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.297846 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6rhv\" (UniqueName: \"kubernetes.io/projected/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-kube-api-access-l6rhv\") pod \"llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p\" (UID: \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\") " pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.421102 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.421014 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.697313 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.697253 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p"] Sep 17 22:38:08.699583 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:38:08.699556 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7edb71f_e5c4_4bb1_8c6e_03502099c08a.slice/crio-2a8b899ea31d722f1e84d8ccb1e4ba1cf33050a3d683a83f746803e5d7a7a587 WatchSource:0}: Error finding container 2a8b899ea31d722f1e84d8ccb1e4ba1cf33050a3d683a83f746803e5d7a7a587: Status 404 returned error can't find the container with id 2a8b899ea31d722f1e84d8ccb1e4ba1cf33050a3d683a83f746803e5d7a7a587 Sep 17 22:38:08.893610 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.893578 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" event={"ID":"a7edb71f-e5c4-4bb1-8c6e-03502099c08a","Type":"ContainerStarted","Data":"2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187"} Sep 17 22:38:08.893798 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.893630 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" event={"ID":"a7edb71f-e5c4-4bb1-8c6e-03502099c08a","Type":"ContainerStarted","Data":"2a8b899ea31d722f1e84d8ccb1e4ba1cf33050a3d683a83f746803e5d7a7a587"} Sep 17 22:38:08.893798 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.893682 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:08.910504 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:08.910441 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" podStartSLOduration=0.910423352 podStartE2EDuration="910.423352ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:38:08.910094203 +0000 UTC m=+2351.261300862" watchObservedRunningTime="2026-09-17 22:38:08.910423352 +0000 UTC m=+2351.261629999" Sep 17 22:38:39.900712 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:39.900678 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:38:59.918320 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:59.918217 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:38:59.924499 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:38:59.924479 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:39:34.025713 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:39:34.025664 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p"] Sep 17 22:39:39.900035 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:39:39.899998 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:39:49.045712 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:39:49.045653 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerName="main" containerID="cri-o://2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187" gracePeriod=45 Sep 17 22:39:49.900006 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:39:49.899969 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:39:59.900167 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:39:59.900128 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:39:59.900615 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:39:59.900246 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:40:09.900247 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:09.900207 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:40:19.279214 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.279191 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:40:19.329965 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.329869 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6rhv\" (UniqueName: \"kubernetes.io/projected/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-kube-api-access-l6rhv\") pod \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\" (UID: \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\") " Sep 17 22:40:19.329965 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.329899 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-tls-certs\") pod \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\" (UID: \"a7edb71f-e5c4-4bb1-8c6e-03502099c08a\") " Sep 17 22:40:19.332256 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.332224 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a7edb71f-e5c4-4bb1-8c6e-03502099c08a" (UID: "a7edb71f-e5c4-4bb1-8c6e-03502099c08a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:40:19.332375 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.332271 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-kube-api-access-l6rhv" (OuterVolumeSpecName: "kube-api-access-l6rhv") pod "a7edb71f-e5c4-4bb1-8c6e-03502099c08a" (UID: "a7edb71f-e5c4-4bb1-8c6e-03502099c08a"). InnerVolumeSpecName "kube-api-access-l6rhv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:40:19.430835 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.430792 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6rhv\" (UniqueName: \"kubernetes.io/projected/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-kube-api-access-l6rhv\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:40:19.430835 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.430831 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7edb71f-e5c4-4bb1-8c6e-03502099c08a-tls-certs\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:40:19.497220 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.497185 2568 generic.go:356] "Generic (PLEG): container finished" podID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerID="2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187" exitCode=0 Sep 17 22:40:19.497361 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.497227 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" Sep 17 22:40:19.497361 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.497226 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" event={"ID":"a7edb71f-e5c4-4bb1-8c6e-03502099c08a","Type":"ContainerDied","Data":"2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187"} Sep 17 22:40:19.497456 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.497363 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p" event={"ID":"a7edb71f-e5c4-4bb1-8c6e-03502099c08a","Type":"ContainerDied","Data":"2a8b899ea31d722f1e84d8ccb1e4ba1cf33050a3d683a83f746803e5d7a7a587"} Sep 17 22:40:19.497456 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.497390 2568 scope.go:117] "RemoveContainer" containerID="2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187" Sep 17 22:40:19.506468 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.506451 2568 scope.go:117] "RemoveContainer" containerID="2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187" Sep 17 22:40:19.506734 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:40:19.506714 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187\": container with ID starting with 2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187 not found: ID does not exist" containerID="2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187" Sep 17 22:40:19.506777 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.506742 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187"} err="failed to get container status \"2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187\": rpc error: code = NotFound desc = could not find container \"2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187\": container with ID starting with 2c43b01cbdfb1dfe0ab49c4187ae8f8dc9775177767d910a46b29c7bd9d38187 not found: ID does not exist" Sep 17 22:40:19.517829 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.517806 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p"] Sep 17 22:40:19.521772 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.521751 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-733055c7/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schezjt2p"] Sep 17 22:40:19.862226 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:40:19.862196 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" path="/var/lib/kubelet/pods/a7edb71f-e5c4-4bb1-8c6e-03502099c08a/volumes" Sep 17 22:42:29.615149 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.615113 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv"] Sep 17 22:42:29.615533 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.615481 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerName="main" Sep 17 22:42:29.615533 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.615493 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerName="main" Sep 17 22:42:29.615634 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.615561 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7edb71f-e5c4-4bb1-8c6e-03502099c08a" containerName="main" Sep 17 22:42:29.618544 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.618528 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:29.621308 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.621283 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"kube-root-ca.crt\"" Sep 17 22:42:29.622227 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.622204 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"default-dockercfg-572zm\"" Sep 17 22:42:29.622342 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.622235 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"openshift-service-ca.crt\"" Sep 17 22:42:29.622491 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.622474 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"router-with-refs-test-epp-sa-dockercfg-275dm\"" Sep 17 22:42:29.622588 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.622567 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-028f7809\"/\"router-with-refs-test-kserve-self-signed-certs\"" Sep 17 22:42:29.627371 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.627343 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv"] Sep 17 22:42:29.759168 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.759130 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlz4v\" (UniqueName: \"kubernetes.io/projected/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-kube-api-access-vlz4v\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv\" (UID: \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:29.759324 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.759176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv\" (UID: \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:29.860223 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.860184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlz4v\" (UniqueName: \"kubernetes.io/projected/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-kube-api-access-vlz4v\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv\" (UID: \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:29.860406 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.860239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv\" (UID: \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:29.862858 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.862831 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv\" (UID: \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:29.871277 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.871226 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlz4v\" (UniqueName: \"kubernetes.io/projected/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-kube-api-access-vlz4v\") pod \"router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv\" (UID: \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\") " pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:29.930150 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:29.930119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:30.199919 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:30.199877 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv"] Sep 17 22:42:30.201957 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:42:30.201926 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5ee9c1_5a8a_4275_8f78_bbf9eb96a85a.slice/crio-a8706a6fc50df65732ea7e55c86e4ab10e71891d8c68aa7c8371a4423d20e1d6 WatchSource:0}: Error finding container a8706a6fc50df65732ea7e55c86e4ab10e71891d8c68aa7c8371a4423d20e1d6: Status 404 returned error can't find the container with id a8706a6fc50df65732ea7e55c86e4ab10e71891d8c68aa7c8371a4423d20e1d6 Sep 17 22:42:31.093311 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:31.093274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" event={"ID":"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a","Type":"ContainerStarted","Data":"f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92"} Sep 17 22:42:31.093722 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:31.093321 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" event={"ID":"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a","Type":"ContainerStarted","Data":"a8706a6fc50df65732ea7e55c86e4ab10e71891d8c68aa7c8371a4423d20e1d6"} Sep 17 22:42:31.093722 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:31.093397 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:42:31.108406 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:42:31.108354 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" podStartSLOduration=2.108337981 podStartE2EDuration="2.108337981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:42:31.10764445 +0000 UTC m=+2613.458851092" watchObservedRunningTime="2026-09-17 22:42:31.108337981 +0000 UTC m=+2613.459544626" Sep 17 22:43:02.100291 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:02.100261 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:43:03.143773 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.143738 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw"] Sep 17 22:43:03.148017 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.147991 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:03.150658 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.150630 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"kube-root-ca.crt\"" Sep 17 22:43:03.152236 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.151824 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-epp-sa-dockercfg-pndzd\"" Sep 17 22:43:03.152236 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.152116 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"openshift-service-ca.crt\"" Sep 17 22:43:03.152236 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.152206 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"stop-feature-test-kserve-self-signed-certs\"" Sep 17 22:43:03.152476 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.152121 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-stop-feature-d9eef2a1\"/\"default-dockercfg-qv8fc\"" Sep 17 22:43:03.154552 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.154524 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw"] Sep 17 22:43:03.249613 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.249579 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958567b-9a47-42f9-8616-3a9af7dd3e2d-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw\" (UID: \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:03.249763 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.249641 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88j2w\" (UniqueName: \"kubernetes.io/projected/c958567b-9a47-42f9-8616-3a9af7dd3e2d-kube-api-access-88j2w\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw\" (UID: \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:03.351055 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.351021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88j2w\" (UniqueName: \"kubernetes.io/projected/c958567b-9a47-42f9-8616-3a9af7dd3e2d-kube-api-access-88j2w\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw\" (UID: \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:03.351243 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.351078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958567b-9a47-42f9-8616-3a9af7dd3e2d-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw\" (UID: \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:03.353695 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.353676 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958567b-9a47-42f9-8616-3a9af7dd3e2d-tls-certs\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw\" (UID: \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:03.358499 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.358478 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88j2w\" (UniqueName: \"kubernetes.io/projected/c958567b-9a47-42f9-8616-3a9af7dd3e2d-kube-api-access-88j2w\") pod \"stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw\" (UID: \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\") " pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:03.460377 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.460348 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:03.739033 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:03.739010 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw"] Sep 17 22:43:03.741045 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:43:03.741009 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc958567b_9a47_42f9_8616_3a9af7dd3e2d.slice/crio-d2e5a46576b218ac89234951562260119db5b408f40cf6c62b939c4b457807c8 WatchSource:0}: Error finding container d2e5a46576b218ac89234951562260119db5b408f40cf6c62b939c4b457807c8: Status 404 returned error can't find the container with id d2e5a46576b218ac89234951562260119db5b408f40cf6c62b939c4b457807c8 Sep 17 22:43:04.251182 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:04.251143 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" event={"ID":"c958567b-9a47-42f9-8616-3a9af7dd3e2d","Type":"ContainerStarted","Data":"2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312"} Sep 17 22:43:04.251575 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:04.251203 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" event={"ID":"c958567b-9a47-42f9-8616-3a9af7dd3e2d","Type":"ContainerStarted","Data":"d2e5a46576b218ac89234951562260119db5b408f40cf6c62b939c4b457807c8"} Sep 17 22:43:04.251575 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:04.251260 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:04.267425 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:04.267379 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" podStartSLOduration=1.267364894 podStartE2EDuration="1.267364894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:43:04.265528886 +0000 UTC m=+2646.616735534" watchObservedRunningTime="2026-09-17 22:43:04.267364894 +0000 UTC m=+2646.618571560" Sep 17 22:43:35.258477 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:35.258440 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:43:59.949854 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:59.949740 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:43:59.957808 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:43:59.957782 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:44:34.077312 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:44:34.077274 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv"] Sep 17 22:44:42.099645 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:44:42.099608 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:44:49.098325 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:44:49.098275 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerName="main" containerID="cri-o://f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92" gracePeriod=45 Sep 17 22:44:52.099381 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:44:52.099341 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:44:54.988006 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:44:54.987954 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw"] Sep 17 22:44:55.258252 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:44:55.258153 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:45:02.099629 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:02.099588 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:45:02.100055 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:02.099705 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:45:05.257885 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:05.257839 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:45:10.009478 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:10.009348 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" containerID="cri-o://2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312" gracePeriod=45 Sep 17 22:45:12.099340 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:12.099296 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:45:15.257732 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:15.257692 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:45:15.258206 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:15.257792 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:45:19.342481 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.342456 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:45:19.347839 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.347817 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-tls-certs\") pod \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\" (UID: \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\") " Sep 17 22:45:19.347994 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.347870 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlz4v\" (UniqueName: \"kubernetes.io/projected/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-kube-api-access-vlz4v\") pod \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\" (UID: \"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a\") " Sep 17 22:45:19.350248 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.350221 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" (UID: "ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:45:19.350322 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.350253 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-kube-api-access-vlz4v" (OuterVolumeSpecName: "kube-api-access-vlz4v") pod "ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" (UID: "ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a"). InnerVolumeSpecName "kube-api-access-vlz4v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:45:19.449161 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.449078 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-tls-certs\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:45:19.449161 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.449108 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlz4v\" (UniqueName: \"kubernetes.io/projected/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a-kube-api-access-vlz4v\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:45:19.905145 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.905112 2568 generic.go:356] "Generic (PLEG): container finished" podID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerID="f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92" exitCode=0 Sep 17 22:45:19.905284 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.905157 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" Sep 17 22:45:19.905284 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.905182 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" event={"ID":"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a","Type":"ContainerDied","Data":"f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92"} Sep 17 22:45:19.905284 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.905221 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv" event={"ID":"ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a","Type":"ContainerDied","Data":"a8706a6fc50df65732ea7e55c86e4ab10e71891d8c68aa7c8371a4423d20e1d6"} Sep 17 22:45:19.905284 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.905241 2568 scope.go:117] "RemoveContainer" containerID="f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92" Sep 17 22:45:19.913885 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.913866 2568 scope.go:117] "RemoveContainer" containerID="f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92" Sep 17 22:45:19.914191 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:45:19.914172 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92\": container with ID starting with f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92 not found: ID does not exist" containerID="f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92" Sep 17 22:45:19.914252 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.914204 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92"} err="failed to get container status \"f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92\": rpc error: code = NotFound desc = could not find container \"f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92\": container with ID starting with f86c11f34ce08278cc92516e5051e1a225a793e7b0c6b5b9f1a60e8e6665dc92 not found: ID does not exist" Sep 17 22:45:19.921250 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.921229 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv"] Sep 17 22:45:19.923869 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:19.923849 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-028f7809/router-with-refs-test-kserve-router-scheduler-5776bf489f-q4xdv"] Sep 17 22:45:21.862672 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:21.862640 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" path="/var/lib/kubelet/pods/ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a/volumes" Sep 17 22:45:25.258554 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:25.258514 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:45:35.257750 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:35.257703 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:45:40.255692 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:40.255667 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:45:40.324714 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:40.324635 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958567b-9a47-42f9-8616-3a9af7dd3e2d-tls-certs\") pod \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\" (UID: \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\") " Sep 17 22:45:40.324714 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:40.324689 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88j2w\" (UniqueName: \"kubernetes.io/projected/c958567b-9a47-42f9-8616-3a9af7dd3e2d-kube-api-access-88j2w\") pod \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\" (UID: \"c958567b-9a47-42f9-8616-3a9af7dd3e2d\") " Sep 17 22:45:40.327084 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:40.327048 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c958567b-9a47-42f9-8616-3a9af7dd3e2d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c958567b-9a47-42f9-8616-3a9af7dd3e2d" (UID: "c958567b-9a47-42f9-8616-3a9af7dd3e2d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:45:40.327177 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:40.327110 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c958567b-9a47-42f9-8616-3a9af7dd3e2d-kube-api-access-88j2w" (OuterVolumeSpecName: "kube-api-access-88j2w") pod "c958567b-9a47-42f9-8616-3a9af7dd3e2d" (UID: "c958567b-9a47-42f9-8616-3a9af7dd3e2d"). InnerVolumeSpecName "kube-api-access-88j2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:45:40.425779 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:40.425744 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c958567b-9a47-42f9-8616-3a9af7dd3e2d-tls-certs\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:45:40.425779 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:40.425774 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88j2w\" (UniqueName: \"kubernetes.io/projected/c958567b-9a47-42f9-8616-3a9af7dd3e2d-kube-api-access-88j2w\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:45:41.006803 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.006769 2568 generic.go:356] "Generic (PLEG): container finished" podID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerID="2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312" exitCode=0 Sep 17 22:45:41.006994 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.006814 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" Sep 17 22:45:41.006994 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.006856 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" event={"ID":"c958567b-9a47-42f9-8616-3a9af7dd3e2d","Type":"ContainerDied","Data":"2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312"} Sep 17 22:45:41.006994 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.006939 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw" event={"ID":"c958567b-9a47-42f9-8616-3a9af7dd3e2d","Type":"ContainerDied","Data":"d2e5a46576b218ac89234951562260119db5b408f40cf6c62b939c4b457807c8"} Sep 17 22:45:41.006994 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.006963 2568 scope.go:117] "RemoveContainer" containerID="2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312" Sep 17 22:45:41.016113 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.016097 2568 scope.go:117] "RemoveContainer" containerID="2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312" Sep 17 22:45:41.016392 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:45:41.016371 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312\": container with ID starting with 2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312 not found: ID does not exist" containerID="2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312" Sep 17 22:45:41.016465 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.016398 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312"} err="failed to get container status \"2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312\": rpc error: code = NotFound desc = could not find container \"2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312\": container with ID starting with 2045f3c731aca71c8cb0d0100a376898d8c5802adc57e7b89afd51777ce4d312 not found: ID does not exist" Sep 17 22:45:41.028689 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.028666 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw"] Sep 17 22:45:41.032892 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.032867 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-stop-feature-d9eef2a1/stop-feature-test-kserve-router-scheduler-7cc9bbb8f8-fv6vw"] Sep 17 22:45:41.863995 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:45:41.863964 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" path="/var/lib/kubelet/pods/c958567b-9a47-42f9-8616-3a9af7dd3e2d/volumes" Sep 17 22:48:59.978517 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:48:59.978489 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:48:59.987221 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:48:59.987200 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:52:39.712658 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.712581 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs"] Sep 17 22:52:39.713148 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.712986 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerName="main" Sep 17 22:52:39.713148 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.713002 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerName="main" Sep 17 22:52:39.713148 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.713013 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" Sep 17 22:52:39.713148 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.713019 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" Sep 17 22:52:39.713148 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.713147 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5ee9c1-5a8a-4275-8f78-bbf9eb96a85a" containerName="main" Sep 17 22:52:39.713422 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.713163 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c958567b-9a47-42f9-8616-3a9af7dd3e2d" containerName="main" Sep 17 22:52:39.716171 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.716156 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:39.719942 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.719891 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-epp-sa-dockercfg-khwd2\"" Sep 17 22:52:39.720057 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.719899 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"openshift-service-ca.crt\"" Sep 17 22:52:39.720183 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.720147 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"kube-root-ca.crt\"" Sep 17 22:52:39.720314 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.720203 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"default-dockercfg-xs6r6\"" Sep 17 22:52:39.720314 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.720234 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-llm-inference-service-b5dd93e6\"/\"router-with-refs-pd-test-kserve-self-signed-certs\"" Sep 17 22:52:39.728595 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.728570 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs"] Sep 17 22:52:39.878505 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.878469 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhbjf\" (UniqueName: \"kubernetes.io/projected/cf900134-74de-43af-b780-0cde68bb68e1-kube-api-access-bhbjf\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs\" (UID: \"cf900134-74de-43af-b780-0cde68bb68e1\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:39.878707 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.878597 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf900134-74de-43af-b780-0cde68bb68e1-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs\" (UID: \"cf900134-74de-43af-b780-0cde68bb68e1\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:39.979399 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.979313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf900134-74de-43af-b780-0cde68bb68e1-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs\" (UID: \"cf900134-74de-43af-b780-0cde68bb68e1\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:39.979399 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.979382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhbjf\" (UniqueName: \"kubernetes.io/projected/cf900134-74de-43af-b780-0cde68bb68e1-kube-api-access-bhbjf\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs\" (UID: \"cf900134-74de-43af-b780-0cde68bb68e1\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:39.982254 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.982220 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf900134-74de-43af-b780-0cde68bb68e1-tls-certs\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs\" (UID: \"cf900134-74de-43af-b780-0cde68bb68e1\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:39.988368 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:39.988336 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhbjf\" (UniqueName: \"kubernetes.io/projected/cf900134-74de-43af-b780-0cde68bb68e1-kube-api-access-bhbjf\") pod \"router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs\" (UID: \"cf900134-74de-43af-b780-0cde68bb68e1\") " pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:40.029861 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:40.029826 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:40.306322 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:40.306293 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs"] Sep 17 22:52:40.308310 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:52:40.308285 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf900134_74de_43af_b780_0cde68bb68e1.slice/crio-b0c6f60a8f288fbadd245fb01910839dfbd12b6ac4fe2cb8d2fb7e41b0831c20 WatchSource:0}: Error finding container b0c6f60a8f288fbadd245fb01910839dfbd12b6ac4fe2cb8d2fb7e41b0831c20: Status 404 returned error can't find the container with id b0c6f60a8f288fbadd245fb01910839dfbd12b6ac4fe2cb8d2fb7e41b0831c20 Sep 17 22:52:40.996675 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:40.996643 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" event={"ID":"cf900134-74de-43af-b780-0cde68bb68e1","Type":"ContainerStarted","Data":"053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa"} Sep 17 22:52:40.997084 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:40.996696 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" event={"ID":"cf900134-74de-43af-b780-0cde68bb68e1","Type":"ContainerStarted","Data":"b0c6f60a8f288fbadd245fb01910839dfbd12b6ac4fe2cb8d2fb7e41b0831c20"} Sep 17 22:52:40.997084 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:40.996741 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:52:41.015110 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:52:41.015060 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" podStartSLOduration=2.015046206 podStartE2EDuration="2.015046206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:52:41.013417827 +0000 UTC m=+3223.364624511" watchObservedRunningTime="2026-09-17 22:52:41.015046206 +0000 UTC m=+3223.366252854" Sep 17 22:53:12.003308 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:53:12.003276 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:54:00.009495 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:54:00.009386 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:54:00.018737 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:54:00.018712 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:54:48.348055 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:54:48.347996 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs"] Sep 17 22:54:52.003199 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:54:52.003163 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:55:02.002432 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:02.002389 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:55:03.368029 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:03.367984 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" containerID="cri-o://053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa" gracePeriod=45 Sep 17 22:55:12.003007 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:12.002957 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:55:12.003612 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:12.003075 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:55:22.002261 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:22.002224 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:55:32.003256 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:32.003213 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 22:55:33.617501 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.617475 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:55:33.709161 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.709136 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf900134-74de-43af-b780-0cde68bb68e1-tls-certs\") pod \"cf900134-74de-43af-b780-0cde68bb68e1\" (UID: \"cf900134-74de-43af-b780-0cde68bb68e1\") " Sep 17 22:55:33.709306 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.709224 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhbjf\" (UniqueName: \"kubernetes.io/projected/cf900134-74de-43af-b780-0cde68bb68e1-kube-api-access-bhbjf\") pod \"cf900134-74de-43af-b780-0cde68bb68e1\" (UID: \"cf900134-74de-43af-b780-0cde68bb68e1\") " Sep 17 22:55:33.711496 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.711462 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf900134-74de-43af-b780-0cde68bb68e1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cf900134-74de-43af-b780-0cde68bb68e1" (UID: "cf900134-74de-43af-b780-0cde68bb68e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 22:55:33.711613 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.711495 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf900134-74de-43af-b780-0cde68bb68e1-kube-api-access-bhbjf" (OuterVolumeSpecName: "kube-api-access-bhbjf") pod "cf900134-74de-43af-b780-0cde68bb68e1" (UID: "cf900134-74de-43af-b780-0cde68bb68e1"). InnerVolumeSpecName "kube-api-access-bhbjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 22:55:33.809812 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.809783 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf900134-74de-43af-b780-0cde68bb68e1-tls-certs\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:55:33.809812 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.809809 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhbjf\" (UniqueName: \"kubernetes.io/projected/cf900134-74de-43af-b780-0cde68bb68e1-kube-api-access-bhbjf\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 22:55:33.810516 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.810487 2568 generic.go:356] "Generic (PLEG): container finished" podID="cf900134-74de-43af-b780-0cde68bb68e1" containerID="053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa" exitCode=0 Sep 17 22:55:33.810615 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.810552 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" Sep 17 22:55:33.810615 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.810579 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" event={"ID":"cf900134-74de-43af-b780-0cde68bb68e1","Type":"ContainerDied","Data":"053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa"} Sep 17 22:55:33.810724 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.810681 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs" event={"ID":"cf900134-74de-43af-b780-0cde68bb68e1","Type":"ContainerDied","Data":"b0c6f60a8f288fbadd245fb01910839dfbd12b6ac4fe2cb8d2fb7e41b0831c20"} Sep 17 22:55:33.810724 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.810715 2568 scope.go:117] "RemoveContainer" containerID="053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa" Sep 17 22:55:33.820383 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.820367 2568 scope.go:117] "RemoveContainer" containerID="053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa" Sep 17 22:55:33.820625 ip-10-0-133-200 kubenswrapper[2568]: E0917 22:55:33.820606 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa\": container with ID starting with 053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa not found: ID does not exist" containerID="053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa" Sep 17 22:55:33.820674 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.820633 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa"} err="failed to get container status \"053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa\": rpc error: code = NotFound desc = could not find container \"053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa\": container with ID starting with 053955f84e63dde8461e69f6129c912b3bd15bde41970c370c746f3b6a3e1eaa not found: ID does not exist" Sep 17 22:55:33.832603 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.832582 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs"] Sep 17 22:55:33.834013 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.833995 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-llm-inference-service-b5dd93e6/router-with-refs-pd-test-kserve-router-scheduler-99c668b4554bzs"] Sep 17 22:55:33.862505 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:55:33.862476 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf900134-74de-43af-b780-0cde68bb68e1" path="/var/lib/kubelet/pods/cf900134-74de-43af-b780-0cde68bb68e1/volumes" Sep 17 22:59:00.045561 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:00.045443 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:59:00.054665 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:00.054642 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 22:59:53.195075 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.195037 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865"] Sep 17 22:59:53.195644 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.195613 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" Sep 17 22:59:53.195644 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.195634 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" Sep 17 22:59:53.195852 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.195737 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf900134-74de-43af-b780-0cde68bb68e1" containerName="main" Sep 17 22:59:53.199055 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.199037 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:53.203010 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.202973 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"prestop-hook-test-epp-sa-dockercfg-d7cck\"" Sep 17 22:59:53.203010 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.202975 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"kube-root-ca.crt\"" Sep 17 22:59:53.203170 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.203013 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"openshift-service-ca.crt\"" Sep 17 22:59:53.203170 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.203041 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"default-dockercfg-fg582\"" Sep 17 22:59:53.203276 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.203182 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-test-prestop-hook-22727e61\"/\"prestop-hook-test-kserve-self-signed-certs\"" Sep 17 22:59:53.209947 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.209927 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865"] Sep 17 22:59:53.276195 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.276162 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b277a865-1426-4b8d-b1be-106450eef9e7-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865\" (UID: \"b277a865-1426-4b8d-b1be-106450eef9e7\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:53.276401 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.276241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfzq7\" (UniqueName: \"kubernetes.io/projected/b277a865-1426-4b8d-b1be-106450eef9e7-kube-api-access-nfzq7\") pod \"prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865\" (UID: \"b277a865-1426-4b8d-b1be-106450eef9e7\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:53.377224 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.377193 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfzq7\" (UniqueName: \"kubernetes.io/projected/b277a865-1426-4b8d-b1be-106450eef9e7-kube-api-access-nfzq7\") pod \"prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865\" (UID: \"b277a865-1426-4b8d-b1be-106450eef9e7\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:53.377378 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.377271 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b277a865-1426-4b8d-b1be-106450eef9e7-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865\" (UID: \"b277a865-1426-4b8d-b1be-106450eef9e7\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:53.379979 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.379956 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b277a865-1426-4b8d-b1be-106450eef9e7-tls-certs\") pod \"prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865\" (UID: \"b277a865-1426-4b8d-b1be-106450eef9e7\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:53.401844 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.401818 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfzq7\" (UniqueName: \"kubernetes.io/projected/b277a865-1426-4b8d-b1be-106450eef9e7-kube-api-access-nfzq7\") pod \"prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865\" (UID: \"b277a865-1426-4b8d-b1be-106450eef9e7\") " pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:53.513050 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.513019 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:53.787814 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:53.787788 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865"] Sep 17 22:59:53.790530 ip-10-0-133-200 kubenswrapper[2568]: W0917 22:59:53.790502 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb277a865_1426_4b8d_b1be_106450eef9e7.slice/crio-016e2aaacc7d61c11cd04d63ca5728a7a02e7d205193a9498e5faa08af5b61c9 WatchSource:0}: Error finding container 016e2aaacc7d61c11cd04d63ca5728a7a02e7d205193a9498e5faa08af5b61c9: Status 404 returned error can't find the container with id 016e2aaacc7d61c11cd04d63ca5728a7a02e7d205193a9498e5faa08af5b61c9 Sep 17 22:59:54.033989 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:54.033943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" event={"ID":"b277a865-1426-4b8d-b1be-106450eef9e7","Type":"ContainerStarted","Data":"1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518"} Sep 17 22:59:54.034174 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:54.034112 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 22:59:54.034174 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:54.034156 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" event={"ID":"b277a865-1426-4b8d-b1be-106450eef9e7","Type":"ContainerStarted","Data":"016e2aaacc7d61c11cd04d63ca5728a7a02e7d205193a9498e5faa08af5b61c9"} Sep 17 22:59:54.052424 ip-10-0-133-200 kubenswrapper[2568]: I0917 22:59:54.052335 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" podStartSLOduration=1.052320954 podStartE2EDuration="1.052320954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 22:59:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 22:59:54.049968896 +0000 UTC m=+3656.401175543" watchObservedRunningTime="2026-09-17 22:59:54.052320954 +0000 UTC m=+3656.403527598" Sep 17 23:00:25.040209 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:00:25.040182 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 23:02:12.080892 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:12.080842 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865"] Sep 17 23:02:15.040791 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:15.040748 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 23:02:25.041025 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:25.040985 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 23:02:27.102071 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:27.102027 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" containerID="cri-o://1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518" gracePeriod=45 Sep 17 23:02:35.040518 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:35.040476 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 23:02:35.040949 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:35.040597 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 23:02:45.040290 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:45.040244 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 23:02:55.040357 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:55.040312 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Sep 17 23:02:57.355531 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.355507 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 23:02:57.409278 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.409197 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfzq7\" (UniqueName: \"kubernetes.io/projected/b277a865-1426-4b8d-b1be-106450eef9e7-kube-api-access-nfzq7\") pod \"b277a865-1426-4b8d-b1be-106450eef9e7\" (UID: \"b277a865-1426-4b8d-b1be-106450eef9e7\") " Sep 17 23:02:57.409278 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.409242 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b277a865-1426-4b8d-b1be-106450eef9e7-tls-certs\") pod \"b277a865-1426-4b8d-b1be-106450eef9e7\" (UID: \"b277a865-1426-4b8d-b1be-106450eef9e7\") " Sep 17 23:02:57.411615 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.411589 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b277a865-1426-4b8d-b1be-106450eef9e7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b277a865-1426-4b8d-b1be-106450eef9e7" (UID: "b277a865-1426-4b8d-b1be-106450eef9e7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 23:02:57.411726 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.411645 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b277a865-1426-4b8d-b1be-106450eef9e7-kube-api-access-nfzq7" (OuterVolumeSpecName: "kube-api-access-nfzq7") pod "b277a865-1426-4b8d-b1be-106450eef9e7" (UID: "b277a865-1426-4b8d-b1be-106450eef9e7"). InnerVolumeSpecName "kube-api-access-nfzq7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 23:02:57.510338 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.510301 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfzq7\" (UniqueName: \"kubernetes.io/projected/b277a865-1426-4b8d-b1be-106450eef9e7-kube-api-access-nfzq7\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 23:02:57.510338 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.510331 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b277a865-1426-4b8d-b1be-106450eef9e7-tls-certs\") on node \"ip-10-0-133-200.ec2.internal\" DevicePath \"\"" Sep 17 23:02:57.908602 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.908564 2568 generic.go:356] "Generic (PLEG): container finished" podID="b277a865-1426-4b8d-b1be-106450eef9e7" containerID="1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518" exitCode=0 Sep 17 23:02:57.908764 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.908616 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" Sep 17 23:02:57.908764 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.908615 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" event={"ID":"b277a865-1426-4b8d-b1be-106450eef9e7","Type":"ContainerDied","Data":"1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518"} Sep 17 23:02:57.908764 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.908677 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865" event={"ID":"b277a865-1426-4b8d-b1be-106450eef9e7","Type":"ContainerDied","Data":"016e2aaacc7d61c11cd04d63ca5728a7a02e7d205193a9498e5faa08af5b61c9"} Sep 17 23:02:57.908764 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.908702 2568 scope.go:117] "RemoveContainer" containerID="1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518" Sep 17 23:02:57.917388 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.917371 2568 scope.go:117] "RemoveContainer" containerID="1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518" Sep 17 23:02:57.917651 ip-10-0-133-200 kubenswrapper[2568]: E0917 23:02:57.917630 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518\": container with ID starting with 1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518 not found: ID does not exist" containerID="1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518" Sep 17 23:02:57.917713 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.917659 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518"} err="failed to get container status \"1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518\": rpc error: code = NotFound desc = could not find container \"1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518\": container with ID starting with 1c5509705cafa1268948389f44996e1d4d57482eb4cf4a5e3b05396111941518 not found: ID does not exist" Sep 17 23:02:57.925564 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.925540 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865"] Sep 17 23:02:57.929774 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:57.929752 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-test-prestop-hook-22727e61/prestop-hook-test-kserve-router-scheduler-58978fbc99-xp865"] Sep 17 23:02:59.862984 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:02:59.862952 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" path="/var/lib/kubelet/pods/b277a865-1426-4b8d-b1be-106450eef9e7/volumes" Sep 17 23:04:00.082322 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:04:00.082205 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 23:04:00.091148 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:04:00.091127 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n26r9_fe4903e3-8151-4d31-97a9-e51c2f97e867/ovn-acl-logging/0.log" Sep 17 23:06:29.776707 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:29.776673 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b7qpx_aecba190-b5c8-440e-b18c-3f696ae64f0c/discovery/0.log" Sep 17 23:06:30.503939 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:30.503891 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b7qpx_aecba190-b5c8-440e-b18c-3f696ae64f0c/discovery/0.log" Sep 17 23:06:31.369123 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:31.369091 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-h7vrw_77990297-74f3-4fd8-9ad6-9587805a0c93/manager/0.log" Sep 17 23:06:31.487471 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:31.487442 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5ffb4b4ccb-drw2c_476c54c3-f994-4c73-a29b-c693e1a50f8e/manager/0.log" Sep 17 23:06:40.312980 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:40.312947 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6rktt_1321b96a-f1b2-40fa-b0aa-d924b37e1e44/global-pull-secret-syncer/0.log" Sep 17 23:06:40.464203 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:40.464172 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cd9k8_326372c5-d53f-4ff7-ad47-aa1dd50257d1/konnectivity-agent/0.log" Sep 17 23:06:40.567369 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:40.567284 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-200.ec2.internal_4c838c3bd5faca9499f3e40b6543bbed/haproxy/0.log" Sep 17 23:06:45.895559 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:45.895532 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-h7vrw_77990297-74f3-4fd8-9ad6-9587805a0c93/manager/0.log" Sep 17 23:06:46.071203 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:46.071175 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5ffb4b4ccb-drw2c_476c54c3-f994-4c73-a29b-c693e1a50f8e/manager/0.log" Sep 17 23:06:47.257514 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.257488 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca5c5203-c9e0-4a00-82f7-d2204307d3e8/alertmanager/0.log" Sep 17 23:06:47.279718 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.279696 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca5c5203-c9e0-4a00-82f7-d2204307d3e8/config-reloader/0.log" Sep 17 23:06:47.301073 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.301050 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca5c5203-c9e0-4a00-82f7-d2204307d3e8/kube-rbac-proxy-web/0.log" Sep 17 23:06:47.322569 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.322547 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca5c5203-c9e0-4a00-82f7-d2204307d3e8/kube-rbac-proxy/0.log" Sep 17 23:06:47.343654 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.343631 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca5c5203-c9e0-4a00-82f7-d2204307d3e8/kube-rbac-proxy-metric/0.log" Sep 17 23:06:47.366364 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.366342 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca5c5203-c9e0-4a00-82f7-d2204307d3e8/prom-label-proxy/0.log" Sep 17 23:06:47.392902 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.392878 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca5c5203-c9e0-4a00-82f7-d2204307d3e8/init-config-reloader/0.log" Sep 17 23:06:47.469993 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.468990 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-v82s2_80628eab-f558-4b2f-ac6d-5fa31a192d9e/kube-state-metrics/0.log" Sep 17 23:06:47.502464 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.502431 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-v82s2_80628eab-f558-4b2f-ac6d-5fa31a192d9e/kube-rbac-proxy-main/0.log" Sep 17 23:06:47.545095 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.545025 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-v82s2_80628eab-f558-4b2f-ac6d-5fa31a192d9e/kube-rbac-proxy-self/0.log" Sep 17 23:06:47.589863 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.589831 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-89684b496-x6d6t_483ceece-3a5a-4fd4-9ce0-dd9d6a417c23/metrics-server/0.log" Sep 17 23:06:47.620785 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.620759 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-9bq9m_06a28afe-4d0c-4629-8e43-2d2bbecf252d/monitoring-plugin/0.log" Sep 17 23:06:47.685750 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.685726 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2j5gl_d02878b7-c37d-497a-b4aa-29173ba19cc2/node-exporter/0.log" Sep 17 23:06:47.710244 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.710218 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2j5gl_d02878b7-c37d-497a-b4aa-29173ba19cc2/kube-rbac-proxy/0.log" Sep 17 23:06:47.730856 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.730834 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2j5gl_d02878b7-c37d-497a-b4aa-29173ba19cc2/init-textfile/0.log" Sep 17 23:06:47.921564 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.921491 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4ztkv_bc1225ac-c234-4db2-86c6-9875ac5cf68e/kube-rbac-proxy-main/0.log" Sep 17 23:06:47.943813 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.943787 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4ztkv_bc1225ac-c234-4db2-86c6-9875ac5cf68e/kube-rbac-proxy-self/0.log" Sep 17 23:06:47.966552 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:47.966530 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-4ztkv_bc1225ac-c234-4db2-86c6-9875ac5cf68e/openshift-state-metrics/0.log" Sep 17 23:06:48.014964 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.014944 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_568bc314-dc43-4d6a-8ab5-adb53448059f/prometheus/0.log" Sep 17 23:06:48.031920 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.031881 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_568bc314-dc43-4d6a-8ab5-adb53448059f/config-reloader/0.log" Sep 17 23:06:48.054143 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.054121 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_568bc314-dc43-4d6a-8ab5-adb53448059f/thanos-sidecar/0.log" Sep 17 23:06:48.081921 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.081882 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_568bc314-dc43-4d6a-8ab5-adb53448059f/kube-rbac-proxy-web/0.log" Sep 17 23:06:48.103880 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.103859 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_568bc314-dc43-4d6a-8ab5-adb53448059f/kube-rbac-proxy/0.log" Sep 17 23:06:48.126520 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.126496 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_568bc314-dc43-4d6a-8ab5-adb53448059f/kube-rbac-proxy-thanos/0.log" Sep 17 23:06:48.147789 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.147770 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_568bc314-dc43-4d6a-8ab5-adb53448059f/init-config-reloader/0.log" Sep 17 23:06:48.176950 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.176891 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-tz5md_db128b62-1113-4364-b05d-86e06e250042/prometheus-operator/0.log" Sep 17 23:06:48.197428 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.197407 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-tz5md_db128b62-1113-4364-b05d-86e06e250042/kube-rbac-proxy/0.log" Sep 17 23:06:48.222093 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.222072 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-6fx74_80ed96cf-0293-408d-806d-91269c0b352a/prometheus-operator-admission-webhook/0.log" Sep 17 23:06:48.341691 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.341668 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d5596c4d5-s5h4w_afa425eb-65a5-40e2-ae40-40801de2ea3a/thanos-query/0.log" Sep 17 23:06:48.363430 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.363409 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d5596c4d5-s5h4w_afa425eb-65a5-40e2-ae40-40801de2ea3a/kube-rbac-proxy-web/0.log" Sep 17 23:06:48.385137 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.385116 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d5596c4d5-s5h4w_afa425eb-65a5-40e2-ae40-40801de2ea3a/kube-rbac-proxy/0.log" Sep 17 23:06:48.406663 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.406643 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d5596c4d5-s5h4w_afa425eb-65a5-40e2-ae40-40801de2ea3a/prom-label-proxy/0.log" Sep 17 23:06:48.428639 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.428587 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d5596c4d5-s5h4w_afa425eb-65a5-40e2-ae40-40801de2ea3a/kube-rbac-proxy-rules/0.log" Sep 17 23:06:48.450152 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:48.450133 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d5596c4d5-s5h4w_afa425eb-65a5-40e2-ae40-40801de2ea3a/kube-rbac-proxy-metrics/0.log" Sep 17 23:06:49.923872 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.923832 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd"] Sep 17 23:06:49.924386 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.924366 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" Sep 17 23:06:49.924464 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.924390 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" Sep 17 23:06:49.924517 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.924506 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b277a865-1426-4b8d-b1be-106450eef9e7" containerName="main" Sep 17 23:06:49.927834 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.927812 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:49.930040 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.930022 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r2jh9\"/\"kube-root-ca.crt\"" Sep 17 23:06:49.930127 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.930022 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r2jh9\"/\"default-dockercfg-gmh4m\"" Sep 17 23:06:49.931278 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.931250 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r2jh9\"/\"openshift-service-ca.crt\"" Sep 17 23:06:49.936073 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:49.936048 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd"] Sep 17 23:06:50.011084 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.011050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-podres\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.011084 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.011085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-proc\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.011341 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.011137 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjr2\" (UniqueName: \"kubernetes.io/projected/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-kube-api-access-czjr2\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.011341 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.011292 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-sys\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.011453 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.011385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-lib-modules\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.112631 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjr2\" (UniqueName: \"kubernetes.io/projected/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-kube-api-access-czjr2\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.112811 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-sys\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.112811 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-lib-modules\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.112811 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112729 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-podres\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.112811 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-proc\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.113041 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112806 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-sys\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.113041 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112838 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-proc\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.113041 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-podres\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.113041 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.112864 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-lib-modules\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.120961 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.120936 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjr2\" (UniqueName: \"kubernetes.io/projected/c2088896-0f07-4d50-bc4c-7026bb6dd6b3-kube-api-access-czjr2\") pod \"perf-node-gather-daemonset-nxqpd\" (UID: \"c2088896-0f07-4d50-bc4c-7026bb6dd6b3\") " pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.243036 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.243004 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:50.517559 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:50.517535 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd"] Sep 17 23:06:50.519749 ip-10-0-133-200 kubenswrapper[2568]: W0917 23:06:50.519719 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc2088896_0f07_4d50_bc4c_7026bb6dd6b3.slice/crio-87a355376273134ed6afc268a13de497eb00263c57ce4fa42c943a2c8dd656d5 WatchSource:0}: Error finding container 87a355376273134ed6afc268a13de497eb00263c57ce4fa42c943a2c8dd656d5: Status 404 returned error can't find the container with id 87a355376273134ed6afc268a13de497eb00263c57ce4fa42c943a2c8dd656d5 Sep 17 23:06:51.001498 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:51.001461 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" event={"ID":"c2088896-0f07-4d50-bc4c-7026bb6dd6b3","Type":"ContainerStarted","Data":"59f29777240a202a3142bd67ab6a77cf0d5e8dad2b43d1a7c60e7559c80c31bc"} Sep 17 23:06:51.001949 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:51.001518 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:51.001949 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:51.001536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" event={"ID":"c2088896-0f07-4d50-bc4c-7026bb6dd6b3","Type":"ContainerStarted","Data":"87a355376273134ed6afc268a13de497eb00263c57ce4fa42c943a2c8dd656d5"} Sep 17 23:06:51.017611 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:51.017555 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" podStartSLOduration=2.017538612 podStartE2EDuration="2.017538612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:51.015738748 +0000 UTC m=+4073.366945393" watchObservedRunningTime="2026-09-17 23:06:51.017538612 +0000 UTC m=+4073.368745281" Sep 17 23:06:52.055490 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:52.055465 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bq5ht_a09779a6-cc7c-4067-89e2-b8c34304ce17/dns/0.log" Sep 17 23:06:52.078058 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:52.078021 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bq5ht_a09779a6-cc7c-4067-89e2-b8c34304ce17/kube-rbac-proxy/0.log" Sep 17 23:06:52.151268 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:52.151241 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fm2vp_81d618d8-0b98-43b8-a9a5-fe3f73d8e4e8/dns-node-resolver/0.log" Sep 17 23:06:52.762959 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:52.762928 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pvtjj_308aba24-dfd1-4096-8bb5-332d01c807c8/node-ca/0.log" Sep 17 23:06:53.760793 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:53.760747 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b7qpx_aecba190-b5c8-440e-b18c-3f696ae64f0c/discovery/0.log" Sep 17 23:06:54.350779 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:54.350743 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m4lk9_15ea6a3f-16d5-412e-8426-5ad259951ef8/serve-healthcheck-canary/0.log" Sep 17 23:06:54.887685 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:54.887635 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmgh8_d43f1aa3-a870-4010-8bfe-405778c29440/kube-rbac-proxy/0.log" Sep 17 23:06:54.908102 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:54.908069 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmgh8_d43f1aa3-a870-4010-8bfe-405778c29440/exporter/0.log" Sep 17 23:06:54.928396 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:54.928374 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gmgh8_d43f1aa3-a870-4010-8bfe-405778c29440/extractor/0.log" Sep 17 23:06:57.016339 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:57.016305 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r2jh9/perf-node-gather-daemonset-nxqpd" Sep 17 23:06:57.864072 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:57.864032 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65d86c4f4c-hcgsd_d99c8776-a4ca-4d10-8cfb-1978c7bb1ad6/manager/0.log" Sep 17 23:06:57.914781 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:57.914736 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nck9v_12f92dd0-f48e-4686-8e28-8888d3ed94ec/openshift-lws-operator/0.log" Sep 17 23:06:59.246123 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:06:59.246079 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b7qpx_aecba190-b5c8-440e-b18c-3f696ae64f0c/discovery/0.log" Sep 17 23:07:00.393637 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:00.393603 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-b7qpx_aecba190-b5c8-440e-b18c-3f696ae64f0c/discovery/0.log" Sep 17 23:07:05.871311 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:05.871283 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2n8p_22d31356-96f2-41e3-a543-eb7c63146aef/kube-multus-additional-cni-plugins/0.log" Sep 17 23:07:05.894520 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:05.894464 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2n8p_22d31356-96f2-41e3-a543-eb7c63146aef/egress-router-binary-copy/0.log" Sep 17 23:07:05.914889 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:05.914866 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2n8p_22d31356-96f2-41e3-a543-eb7c63146aef/cni-plugins/0.log" Sep 17 23:07:05.934972 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:05.934955 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2n8p_22d31356-96f2-41e3-a543-eb7c63146aef/bond-cni-plugin/0.log" Sep 17 23:07:05.955412 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:05.955388 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2n8p_22d31356-96f2-41e3-a543-eb7c63146aef/routeoverride-cni/0.log" Sep 17 23:07:05.976578 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:05.976561 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2n8p_22d31356-96f2-41e3-a543-eb7c63146aef/whereabouts-cni-bincopy/0.log" Sep 17 23:07:05.997629 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:05.997609 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s2n8p_22d31356-96f2-41e3-a543-eb7c63146aef/whereabouts-cni/0.log" Sep 17 23:07:06.113475 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:06.113443 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wbvsn_1d93b2fb-c3e3-4969-8805-8f3a7be1878d/kube-multus/0.log" Sep 17 23:07:06.179511 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:06.179435 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hbsxf_0f735753-7333-48b5-9d5f-6f4dda9f29e1/network-metrics-daemon/0.log" Sep 17 23:07:06.201383 ip-10-0-133-200 kubenswrapper[2568]: I0917 23:07:06.201354 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hbsxf_0f735753-7333-48b5-9d5f-6f4dda9f29e1/kube-rbac-proxy/0.log"