Sep 10 02:31:44.849287 ip-10-0-143-27 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 02:31:44.849302 ip-10-0-143-27 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 02:31:44.849309 ip-10-0-143-27 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 02:31:44.849652 ip-10-0-143-27 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 02:31:55.016050 ip-10-0-143-27 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 02:31:55.016065 ip-10-0-143-27 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 277c05b5782d4e22910c09a742a10326 -- Sep 10 02:33:53.673214 ip-10-0-143-27 systemd[1]: Starting Kubernetes Kubelet... Sep 10 02:33:54.048923 ip-10-0-143-27 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:33:54.048923 ip-10-0-143-27 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 02:33:54.048923 ip-10-0-143-27 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:33:54.048923 ip-10-0-143-27 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 02:33:54.049436 ip-10-0-143-27 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 02:33:54.050531 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.050465 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 02:33:54.055536 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055522 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:54.055536 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055536 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055540 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055543 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055546 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055549 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055551 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055554 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055556 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055559 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055567 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055573 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055576 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055579 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055582 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055585 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055588 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055591 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055594 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055597 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055599 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:54.055598 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055602 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055605 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055607 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055610 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055613 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055616 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055618 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055620 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055623 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055625 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055628 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055630 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055633 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055635 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055638 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055640 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055643 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055645 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055648 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:54.056086 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055650 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055653 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055655 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055658 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055660 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055662 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055665 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055667 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055669 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055672 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055674 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055677 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055680 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055683 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055686 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055689 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055691 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055694 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055697 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055700 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:54.056552 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055702 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055704 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055707 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055709 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055712 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055715 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055717 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055720 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055722 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055725 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055729 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055732 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055737 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055740 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055743 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055746 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055749 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055752 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055755 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:54.057055 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055758 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055760 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055763 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055766 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055770 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055773 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055775 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055778 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055782 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055784 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055787 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055789 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055792 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055795 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055797 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055800 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055802 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055805 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055809 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:54.057546 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.055811 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056522 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056531 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056534 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056536 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056539 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056542 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056545 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056547 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056550 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056553 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056556 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056558 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056561 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056564 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056567 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056569 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056572 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056575 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056577 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:54.058031 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056580 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056583 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056586 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056588 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056590 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056593 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056595 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056597 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056600 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056602 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056604 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056607 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056610 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056612 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056615 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056617 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056620 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056623 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056626 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056628 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:54.058528 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056631 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056633 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056635 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056638 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056640 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056643 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056645 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056648 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056650 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056653 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056656 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056659 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056661 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056664 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056666 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056669 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056671 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056674 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056676 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056678 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:54.059030 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056681 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056683 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056686 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056688 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056690 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056695 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056698 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056701 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056704 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056708 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056712 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056716 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056719 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056721 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056724 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056727 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056731 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056733 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056736 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:54.059517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056738 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056741 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056744 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056747 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056750 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056752 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056755 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056757 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056760 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056764 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056767 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056770 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056773 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056776 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056779 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056782 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056784 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056787 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056790 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056793 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:54.059989 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.056796 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057158 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057163 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057166 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057169 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057171 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057174 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057177 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057179 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057182 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057184 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057187 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057189 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057192 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057195 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057198 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057200 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057203 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057206 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057208 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:54.060484 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057211 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057213 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057216 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057218 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057221 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057223 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057226 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057229 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057231 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057233 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057236 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057239 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057241 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057244 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057246 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057249 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057252 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057254 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057257 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057259 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:54.060982 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057261 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057264 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057266 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057269 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057271 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057274 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057276 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057279 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057281 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057284 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057286 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057289 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057291 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057294 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057296 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057298 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057301 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057303 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057306 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057308 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:54.061561 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057310 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057314 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057320 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057323 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057326 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057328 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057332 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057335 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057337 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057340 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057342 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057345 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057347 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057350 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057352 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057355 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057359 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057362 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:54.062061 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057366 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057369 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057371 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057374 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057376 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057378 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057382 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057385 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057388 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057391 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057394 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057396 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057399 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057401 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057404 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057406 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057410 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057412 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057415 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057418 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:54.062535 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057422 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.057424 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057493 2559 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057525 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057531 2559 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057535 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057540 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057543 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057547 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057551 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057554 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057558 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057562 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057565 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057568 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057570 2559 flags.go:64] FLAG: --cgroup-root="" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057573 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057576 2559 flags.go:64] FLAG: --client-ca-file="" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057579 2559 flags.go:64] FLAG: --cloud-provider="external" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057582 2559 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057585 2559 flags.go:64] FLAG: --cluster-domain="" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057588 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057591 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057594 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 02:33:54.063039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057597 2559 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057600 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057603 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057606 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057610 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057613 2559 flags.go:64] FLAG: --contention-profiling="false" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057616 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057619 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057623 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057626 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057629 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057632 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057635 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057638 2559 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057641 2559 flags.go:64] FLAG: --enable-server="true" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057643 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057647 2559 flags.go:64] FLAG: --event-burst="100" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057650 2559 flags.go:64] FLAG: --event-qps="50" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057652 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057655 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057658 2559 flags.go:64] FLAG: --eviction-hard="" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057661 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057664 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057667 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057669 2559 flags.go:64] FLAG: --eviction-soft="" Sep 10 02:33:54.063620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057672 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057675 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057678 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057680 2559 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057683 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057686 2559 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057688 2559 flags.go:64] FLAG: --feature-gates="" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057692 2559 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057695 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057697 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057700 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057705 2559 flags.go:64] FLAG: --healthz-port="10248" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057708 2559 flags.go:64] FLAG: --help="false" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057710 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057713 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057716 2559 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057720 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057723 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057727 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057729 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057732 2559 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057735 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057737 2559 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 02:33:54.064264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057740 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057743 2559 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057746 2559 flags.go:64] FLAG: --kube-reserved="" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057749 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057751 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057754 2559 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057757 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057759 2559 flags.go:64] FLAG: --lock-file="" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057762 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057765 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057768 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057773 2559 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057775 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057778 2559 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057780 2559 flags.go:64] FLAG: --logging-format="text" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057783 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057786 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057789 2559 flags.go:64] FLAG: --manifest-url="" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057792 2559 flags.go:64] FLAG: --manifest-url-header="" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057795 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057799 2559 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057803 2559 flags.go:64] FLAG: --max-pods="110" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057806 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057809 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057812 2559 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 02:33:54.064864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057814 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057820 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057823 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057826 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057832 2559 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057835 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057838 2559 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057841 2559 flags.go:64] FLAG: --pod-cidr="" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057844 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057849 2559 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057852 2559 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057855 2559 flags.go:64] FLAG: --pods-per-core="0" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057857 2559 flags.go:64] FLAG: --port="10250" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057860 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057863 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03c0659398f8d1521" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057866 2559 flags.go:64] FLAG: --qos-reserved="" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057868 2559 flags.go:64] FLAG: --read-only-port="10255" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057871 2559 flags.go:64] FLAG: --register-node="true" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057874 2559 flags.go:64] FLAG: --register-with-taints="" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057877 2559 flags.go:64] FLAG: --registry-burst="10" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057880 2559 flags.go:64] FLAG: --registry-qps="5" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057883 2559 flags.go:64] FLAG: --reserved-cpus="" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057885 2559 flags.go:64] FLAG: --reserved-memory="" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057888 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057892 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 02:33:54.065631 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057894 2559 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057897 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057900 2559 flags.go:64] FLAG: --runonce="false" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057904 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057907 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057909 2559 flags.go:64] FLAG: --seccomp-default="false" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057912 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057916 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057919 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057922 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057943 2559 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057947 2559 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057950 2559 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057953 2559 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057956 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057959 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057962 2559 flags.go:64] FLAG: --system-cgroups="" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057964 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057969 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057972 2559 flags.go:64] FLAG: --tls-cert-file="" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057975 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057979 2559 flags.go:64] FLAG: --tls-min-version="" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057981 2559 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057984 2559 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057987 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 02:33:54.066502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057990 2559 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057993 2559 flags.go:64] FLAG: --v="2" Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.057996 2559 flags.go:64] FLAG: --version="false" Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.058000 2559 flags.go:64] FLAG: --vmodule="" Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.058003 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.058006 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058111 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058116 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058119 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058121 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058125 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058127 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058130 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058134 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058137 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058139 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058142 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058145 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058148 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058150 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058153 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:54.067146 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058155 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058158 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058160 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058163 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058165 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058167 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058170 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058172 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058175 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058177 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058179 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058182 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058184 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058187 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058189 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058192 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058194 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058197 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058199 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058201 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:54.067661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058204 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058207 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058209 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058212 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058216 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058218 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058221 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058223 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058225 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058228 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058230 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058233 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058237 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058240 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058243 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058246 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058249 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058252 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058255 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:54.068230 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058259 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058262 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058265 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058268 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058270 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058272 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058275 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058277 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058280 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058282 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058285 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058287 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058289 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058292 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058296 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058299 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058301 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058305 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058308 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058310 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:54.068708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058312 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058315 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058318 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058320 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058323 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058325 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058328 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058330 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058333 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058335 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058339 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058342 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058345 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058348 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058351 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058353 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058356 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058358 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058361 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:54.069211 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058364 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058366 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058369 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058371 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058374 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.058376 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.059067 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.067810 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.067825 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.068567 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.068575 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068629 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068635 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068638 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068641 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:54.069708 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068644 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068647 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068649 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068652 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068654 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068657 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068660 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068662 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068666 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068670 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068673 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068677 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068679 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068682 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068685 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068687 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068690 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068693 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068695 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068698 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:54.070102 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068700 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068704 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068706 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068708 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068712 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068715 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068718 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068720 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068723 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068726 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068728 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068731 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068733 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068736 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068738 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068741 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068743 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068746 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068749 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:54.070576 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068751 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068754 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068756 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068758 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068761 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068764 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068766 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068769 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068771 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068774 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068776 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068779 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068781 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068784 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068786 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068788 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068791 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068794 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068797 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:54.071041 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068800 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068803 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068806 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068810 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068813 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068816 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068818 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068821 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068823 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068825 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068828 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068830 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068833 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068835 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068838 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068840 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068842 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068846 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068849 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068852 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:54.071509 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068854 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068857 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068861 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068863 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068866 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068869 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068872 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068874 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068877 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068880 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068883 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068886 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068889 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068891 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068894 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068896 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:54.072050 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.068899 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.068904 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069019 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069025 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069028 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069031 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069034 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069037 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069040 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069043 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069045 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069048 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069051 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069053 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069056 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 02:33:54.072456 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069059 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069062 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069064 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069066 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069069 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069071 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069074 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069077 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069079 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069082 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069085 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069087 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069090 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069093 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069096 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069098 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069101 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069103 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069105 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 02:33:54.072816 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069108 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069111 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069113 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069115 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069118 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069120 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069123 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069125 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069128 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069130 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069133 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069135 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069138 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069141 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069143 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069146 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069148 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069150 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069153 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069155 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 02:33:54.073292 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069159 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069162 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069164 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069167 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069169 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069172 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069174 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069177 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069179 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069182 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069184 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069187 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069189 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069191 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069194 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069196 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069199 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069201 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069203 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069206 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 02:33:54.073781 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069209 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069211 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069214 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069216 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069219 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069222 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069225 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069227 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069231 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069234 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069238 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069241 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069244 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069247 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069250 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069253 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069256 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069258 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069261 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 02:33:54.074273 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069264 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069267 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069270 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069272 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069275 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069277 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069280 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:54.069282 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.069286 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.069381 2559 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.072175 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.072961 2559 server.go:1019] "Starting client certificate rotation" Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.073060 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 02:33:54.074741 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.073097 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 02:33:54.075305 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.075292 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 02:33:54.076376 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.076359 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 02:33:54.083981 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.083964 2559 log.go:25] "Validated CRI v1 runtime API" Sep 10 02:33:54.087323 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.087306 2559 log.go:25] "Validated CRI v1 image API" Sep 10 02:33:54.091185 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.091162 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 02:33:54.093363 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.093342 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a2e1bcad-be41-45c7-a2df-2154c0f879fe:/dev/nvme0n1p4 c741fbbf-7e87-44b3-8b42-783c179b9ca6:/dev/nvme0n1p3] Sep 10 02:33:54.093454 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.093361 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 02:33:54.098290 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.098139 2559 manager.go:216] Machine: {Timestamp:2026-09-10 02:33:54.097668154 +0000 UTC m=+0.312653683 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097334 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2820c885e7bdceb333a188ddf6a514 SystemUUID:ec2820c8-85e7-bdce-b333-a188ddf6a514 BootID:277c05b5-782d-4e22-910c-09a742a10326 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:88:d4:fd:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:88:d4:fd:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:a6:57:a5:26:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 02:33:54.098290 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.098282 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 02:33:54.098461 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.098368 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 02:33:54.100117 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.100094 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 02:33:54.100264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.100119 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 02:33:54.100831 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.100820 2559 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 02:33:54.100868 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.100834 2559 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 02:33:54.100868 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.100841 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 02:33:54.101406 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.101395 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 02:33:54.102168 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.102158 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 02:33:54.103359 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.103344 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 02:33:54.106160 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106148 2559 state_mem.go:36] "Initialized new in-memory state store" Sep 10 02:33:54.106291 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106282 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 02:33:54.106324 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106309 2559 kubelet.go:486] "Attempting to sync node with API server" Sep 10 02:33:54.106324 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106322 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 02:33:54.106381 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106332 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 02:33:54.106381 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106340 2559 kubelet.go:398] "Adding apiserver pod source" Sep 10 02:33:54.106381 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106348 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 02:33:54.106703 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106675 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 02:33:54.106848 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.106713 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 02:33:54.110044 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.110022 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 02:33:54.112258 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.112245 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 02:33:54.112306 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.112276 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 02:33:54.113473 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113461 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113477 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113483 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113488 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113496 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113501 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113514 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113520 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113526 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113531 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 02:33:54.113537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113539 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 02:33:54.113793 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.113544 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 02:33:54.114612 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.114603 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 02:33:54.114612 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.114612 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 02:33:54.118669 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.118653 2559 server.go:1268] "Started kubelet" Sep 10 02:33:54.118795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.118754 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 02:33:54.118842 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.118813 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 02:33:54.119334 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.119298 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 02:33:54.119447 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.119413 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 02:33:54.119508 ip-10-0-143-27 systemd[1]: Started Kubernetes Kubelet. Sep 10 02:33:54.120026 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.119509 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 02:33:54.120026 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.119593 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 02:33:54.120026 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.119886 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 02:33:54.121615 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.121596 2559 server.go:310] "Adding debug handlers to kubelet server" Sep 10 02:33:54.123720 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.123703 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 02:33:54.124016 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.122918 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-27.ec2.internal.18d3d4f6f41a381e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-27.ec2.internal,UID:ip-10-0-143-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-27.ec2.internal,},FirstTimestamp:2026-09-10 02:33:54.118621214 +0000 UTC m=+0.333606728,LastTimestamp:2026-09-10 02:33:54.118621214 +0000 UTC m=+0.333606728,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-27.ec2.internal,}" Sep 10 02:33:54.124769 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.124750 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 02:33:54.124866 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.124766 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 02:33:54.124866 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.124854 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.125425 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.125408 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 02:33:54.125425 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.125425 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 02:33:54.125606 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.125536 2559 reconstruct.go:97] "Volume reconstruction finished" Sep 10 02:33:54.125606 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.125543 2559 reconciler.go:29] "Reconciler: start to sync state" Sep 10 02:33:54.125606 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.125590 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nkxwg" Sep 10 02:33:54.125798 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.125780 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 02:33:54.125983 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.125961 2559 factory.go:55] Registering systemd factory Sep 10 02:33:54.126060 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.125986 2559 factory.go:223] Registration of the systemd container factory successfully Sep 10 02:33:54.126221 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.126207 2559 factory.go:153] Registering CRI-O factory Sep 10 02:33:54.126269 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.126226 2559 factory.go:223] Registration of the crio container factory successfully Sep 10 02:33:54.126303 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.126277 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 02:33:54.126303 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.126296 2559 factory.go:103] Registering Raw factory Sep 10 02:33:54.126369 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.126309 2559 manager.go:1196] Started watching for new ooms in manager Sep 10 02:33:54.126699 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.126686 2559 manager.go:349] Starting recovery of all containers Sep 10 02:33:54.134517 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.134489 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nkxwg" Sep 10 02:33:54.136757 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.136730 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 02:33:54.136872 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.136852 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 02:33:54.137745 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.137725 2559 manager.go:354] Recovery completed Sep 10 02:33:54.143448 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.143353 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:54.145078 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.145055 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:54.145131 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.145080 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:54.145131 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.145101 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:54.145620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.145604 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 02:33:54.145620 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.145617 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:54.145737 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.145620 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 02:33:54.145737 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.145665 2559 state_mem.go:36] "Initialized new in-memory state store" Sep 10 02:33:54.146264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.146251 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:54.146307 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.146275 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:54.146307 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.146285 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:54.147708 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.147697 2559 policy_none.go:49] "None policy: Start" Sep 10 02:33:54.147742 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.147712 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 02:33:54.147742 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.147721 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 02:33:54.149666 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.149657 2559 policy_none.go:47] "Start" Sep 10 02:33:54.183458 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.183444 2559 manager.go:337] "Starting Device Plugin manager" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.183475 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.183485 2559 server.go:87] "Starting device plugin registration server" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.183735 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.183744 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.183894 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.183992 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.184000 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.184401 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 02:33:54.205729 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.184465 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.258540 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.258521 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 02:33:54.259785 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.259767 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 02:33:54.259855 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.259844 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 02:33:54.259902 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.259876 2559 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 02:33:54.259984 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.259966 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 02:33:54.261777 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.261757 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:54.284881 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.284866 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:54.285572 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.285557 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:54.285641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.285582 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:54.285641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.285591 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:54.285641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.285608 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.290980 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.290965 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.291060 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.290989 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-27.ec2.internal\": node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.301942 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.301868 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.360554 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.360533 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal"] Sep 10 02:33:54.360613 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.360588 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:54.361870 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.361856 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:54.361939 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.361882 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:54.361939 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.361891 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:54.364063 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364051 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:54.364197 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364183 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.364235 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364210 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:54.364740 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364719 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:54.364740 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364730 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:54.364855 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364746 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:54.364855 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364756 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:54.364855 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364755 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:54.364855 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.364778 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:54.366781 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.366768 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.366849 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.366790 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 02:33:54.367422 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.367408 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientMemory" Sep 10 02:33:54.367515 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.367436 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 02:33:54.367515 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.367449 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeHasSufficientPID" Sep 10 02:33:54.390456 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.390440 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-27.ec2.internal\" not found" node="ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.394631 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.394617 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-27.ec2.internal\" not found" node="ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.402678 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.402664 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.503513 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.503490 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.527880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.527859 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43c6e8f9bb9c38ea54330318f6fcad24-config\") pod \"kube-apiserver-proxy-ip-10-0-143-27.ec2.internal\" (UID: \"43c6e8f9bb9c38ea54330318f6fcad24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.527963 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.527883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eaeb717ed3add7fed81b6d35171dc301-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"eaeb717ed3add7fed81b6d35171dc301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.527963 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.527901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eaeb717ed3add7fed81b6d35171dc301-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"eaeb717ed3add7fed81b6d35171dc301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.604127 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.604077 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.628582 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.628560 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43c6e8f9bb9c38ea54330318f6fcad24-config\") pod \"kube-apiserver-proxy-ip-10-0-143-27.ec2.internal\" (UID: \"43c6e8f9bb9c38ea54330318f6fcad24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.628638 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.628586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eaeb717ed3add7fed81b6d35171dc301-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"eaeb717ed3add7fed81b6d35171dc301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.628638 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.628602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eaeb717ed3add7fed81b6d35171dc301-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"eaeb717ed3add7fed81b6d35171dc301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.628638 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.628632 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eaeb717ed3add7fed81b6d35171dc301-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"eaeb717ed3add7fed81b6d35171dc301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.628728 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.628646 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43c6e8f9bb9c38ea54330318f6fcad24-config\") pod \"kube-apiserver-proxy-ip-10-0-143-27.ec2.internal\" (UID: \"43c6e8f9bb9c38ea54330318f6fcad24\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.628728 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.628670 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eaeb717ed3add7fed81b6d35171dc301-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal\" (UID: \"eaeb717ed3add7fed81b6d35171dc301\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.692718 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.692689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.698271 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:54.698256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Sep 10 02:33:54.704733 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.704716 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.805226 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.805191 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:54.905776 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:54.905730 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:55.006186 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:55.006158 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:55.072713 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.072692 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 02:33:55.073200 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.072815 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 02:33:55.104309 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.104289 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:55.106322 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:55.106299 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:55.140419 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.140382 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 02:28:54 +0000 UTC" deadline="2028-04-08 11:09:51.080757408 +0000 UTC" Sep 10 02:33:55.140419 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.140416 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13832h35m55.940344419s" Sep 10 02:33:55.206737 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:55.206681 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-27.ec2.internal\" not found" Sep 10 02:33:55.236071 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.236048 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:55.264226 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:55.264190 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaeb717ed3add7fed81b6d35171dc301.slice/crio-4b95334afe92e46ce83fbe51e58fca2b822ce1f5626059d4cacb5c0074a1a137 WatchSource:0}: Error finding container 4b95334afe92e46ce83fbe51e58fca2b822ce1f5626059d4cacb5c0074a1a137: Status 404 returned error can't find the container with id 4b95334afe92e46ce83fbe51e58fca2b822ce1f5626059d4cacb5c0074a1a137 Sep 10 02:33:55.264661 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:55.264642 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c6e8f9bb9c38ea54330318f6fcad24.slice/crio-d5f41ecc2703780c9f7a57dd956560dddd7553fd5cb6af2758b71b5884bbf6c4 WatchSource:0}: Error finding container d5f41ecc2703780c9f7a57dd956560dddd7553fd5cb6af2758b71b5884bbf6c4: Status 404 returned error can't find the container with id d5f41ecc2703780c9f7a57dd956560dddd7553fd5cb6af2758b71b5884bbf6c4 Sep 10 02:33:55.268653 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.268641 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 02:33:55.324894 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.324876 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" Sep 10 02:33:55.337024 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.337010 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 02:33:55.338232 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.338220 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" Sep 10 02:33:55.348829 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.348812 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 02:33:55.523289 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:55.523233 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:56.107699 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.107618 2559 apiserver.go:52] "Watching apiserver" Sep 10 02:33:56.121241 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.121206 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 02:33:56.121601 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.121567 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq","openshift-dns/node-resolver-gr2bh","openshift-image-registry/node-ca-dskqq","openshift-multus/multus-psvlk","openshift-network-diagnostics/network-check-target-62kk4","openshift-ovn-kubernetes/ovnkube-node-rcwss","kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x69dd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal","openshift-multus/multus-additional-cni-plugins-ltlr4","openshift-multus/network-metrics-daemon-fsnp7","openshift-network-operator/iptables-alerter-p76kk","kube-system/global-pull-secret-syncer-tglws","kube-system/konnectivity-agent-kf6nh"] Sep 10 02:33:56.124470 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.124450 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.125261 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.125241 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 02:33:56.127119 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.127089 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 02:33:56.127229 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.127195 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 02:33:56.127424 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.127405 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 02:33:56.127424 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.127417 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 02:33:56.127659 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.127639 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 02:33:56.127876 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.127856 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tdgc2\"" Sep 10 02:33:56.131743 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.131721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.131838 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.131798 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:33:56.134090 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.134070 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.136283 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.136261 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.136773 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.136724 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 02:33:56.136860 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.136777 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hb847\"" Sep 10 02:33:56.136951 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.136934 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 02:33:56.137075 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137059 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 02:33:56.137160 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-system-cni-dir\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.137234 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.137234 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.137234 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hpbm\" (UniqueName: \"kubernetes.io/projected/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-kube-api-access-9hpbm\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.137234 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-kubelet-config\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.137435 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.137435 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cnibin\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.137435 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.137435 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.137435 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.137355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-dbus\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.138511 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.138489 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 02:33:56.139153 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.138701 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z7php\"" Sep 10 02:33:56.139153 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.139071 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:33:56.139153 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.139127 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:33:56.140072 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.139466 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 02:33:56.141740 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.141449 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.144346 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.144312 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 02:33:56.144605 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.144578 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 02:33:56.144813 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.144795 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 02:33:56.145009 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.144976 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 02:33:56.145362 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.145339 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c4sh9\"" Sep 10 02:33:56.145671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.145655 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 02:33:56.145863 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.145835 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 02:33:56.146217 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.146198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:33:56.146796 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.146778 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.149052 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.148788 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 02:33:56.149052 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.148899 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 02:33:56.149208 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.149100 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.149322 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.149301 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4f9cf\"" Sep 10 02:33:56.149533 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.149514 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-skq9b\"" Sep 10 02:33:56.149605 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.149591 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 02:33:56.150597 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.150578 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:33:56.152466 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.152406 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 02:33:56.156150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.156127 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7lnzb\"" Sep 10 02:33:56.156578 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.156558 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 02:33:56.156688 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.156670 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.159027 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.159007 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 02:33:56.159283 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.159253 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 02:33:56.159364 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.159317 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 02:33:56.159506 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.159482 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6zcsq\"" Sep 10 02:33:56.159974 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.159920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:56.160095 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.160057 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:33:56.162197 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.162119 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zwq9f" Sep 10 02:33:56.163149 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.163125 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.165782 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.165762 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:33:56.165881 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.165836 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 02:33:56.165881 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.165857 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mq2tf\"" Sep 10 02:33:56.166153 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.166136 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 02:33:56.169665 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.169646 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zwq9f" Sep 10 02:33:56.226969 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.226895 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 02:33:56.238461 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86pv2\" (UniqueName: \"kubernetes.io/projected/edcf4db9-ad51-432f-a6a2-bf4704eefc09-kube-api-access-86pv2\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.238570 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-run-netns\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.238570 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238509 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.238570 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55c21cc0-e3c4-4397-aebe-73777fd14832-hosts-file\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.238700 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-registration-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.238700 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:56.238700 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-conf-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c23d9d00-417f-4931-b4d3-f400c5f7c65b-host-slash\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrpm8\" (UniqueName: \"kubernetes.io/projected/c23d9d00-417f-4931-b4d3-f400c5f7c65b-kube-api-access-mrpm8\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238750 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-system-cni-dir\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hpbm\" (UniqueName: \"kubernetes.io/projected/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-kube-api-access-9hpbm\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-kubelet\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-lib-modules\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238856 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kng9h\" (UniqueName: \"kubernetes.io/projected/55c21cc0-e3c4-4397-aebe-73777fd14832-kube-api-access-kng9h\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238861 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-system-cni-dir\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.238880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2j6\" (UniqueName: \"kubernetes.io/projected/85b9bd65-e2a8-49f8-943c-f8419898584f-kube-api-access-tr2j6\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238911 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-netns\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.238935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-kubelet\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-run\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239097 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-cni-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-socket-dir-parent\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-k8s-cni-cncf-io\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-cni-netd\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-cnibin\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-dbus\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-multus-certs\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.239390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/001505d9-7034-4917-9d20-1617b28991e7-konnectivity-ca\") pod \"konnectivity-agent-kf6nh\" (UID: \"001505d9-7034-4917-9d20-1617b28991e7\") " pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-modprobe-d\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239421 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-dbus\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysctl-conf\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/001505d9-7034-4917-9d20-1617b28991e7-agent-certs\") pod \"konnectivity-agent-kf6nh\" (UID: \"001505d9-7034-4917-9d20-1617b28991e7\") " pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-kubernetes\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-host\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239624 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-slash\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-node-log\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vdcp\" (UniqueName: \"kubernetes.io/projected/054304ea-1c6d-48fc-aaa8-8339373832c9-kube-api-access-5vdcp\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-cni-multus\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-etc-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.239895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cnibin\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-etc-kubernetes\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-systemd-units\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovnkube-script-lib\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq9dg\" (UniqueName: \"kubernetes.io/projected/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-kube-api-access-bq9dg\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edcf4db9-ad51-432f-a6a2-bf4704eefc09-cni-binary-copy\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-hostroot\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.239977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-env-overrides\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c23d9d00-417f-4931-b4d3-f400c5f7c65b-iptables-alerter-script\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-log-socket\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240036 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-cni-bin\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovn-node-metrics-cert\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240068 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bded73a-92e1-45bf-81b3-8614cf134d27-serviceca\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp542\" (UniqueName: \"kubernetes.io/projected/9bded73a-92e1-45bf-81b3-8614cf134d27-kube-api-access-fp542\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-var-lib-kubelet\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-tuned\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.240641 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240252 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cnibin\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-sys-fs\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-daemon-config\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bded73a-92e1-45bf-81b3-8614cf134d27-host\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysctl-d\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-systemd\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-ovn\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-sys\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b125e0b5-cd8b-4b8d-a762-4ed802533c45-tmp\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-kubelet-config\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240638 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55c21cc0-e3c4-4397-aebe-73777fd14832-tmp-dir\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240611 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.241539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-cni-bin\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240699 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-kubelet-config\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-var-lib-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-systemd\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-device-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-system-cni-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.240806 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovnkube-config\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysconfig\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.240866 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret podName:7b1b6871-29ad-4c86-8d5e-ad9470704f9e nodeName:}" failed. No retries permitted until 2026-09-10 02:33:56.740845801 +0000 UTC m=+2.955831308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret") pod "global-pull-secret-syncer-tglws" (UID: "7b1b6871-29ad-4c86-8d5e-ad9470704f9e") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cszn7\" (UniqueName: \"kubernetes.io/projected/b125e0b5-cd8b-4b8d-a762-4ed802533c45-kube-api-access-cszn7\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.240928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-socket-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.242344 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.241177 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.250961 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.250932 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 02:33:56.255501 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.255477 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hpbm\" (UniqueName: \"kubernetes.io/projected/a0784fe7-0641-4c4f-b6c8-b82c0f1ab538-kube-api-access-9hpbm\") pod \"multus-additional-cni-plugins-ltlr4\" (UID: \"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538\") " pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.266377 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.266340 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" event={"ID":"eaeb717ed3add7fed81b6d35171dc301","Type":"ContainerStarted","Data":"4b95334afe92e46ce83fbe51e58fca2b822ce1f5626059d4cacb5c0074a1a137"} Sep 10 02:33:56.267829 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.267800 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" event={"ID":"43c6e8f9bb9c38ea54330318f6fcad24","Type":"ContainerStarted","Data":"d5f41ecc2703780c9f7a57dd956560dddd7553fd5cb6af2758b71b5884bbf6c4"} Sep 10 02:33:56.341670 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55c21cc0-e3c4-4397-aebe-73777fd14832-hosts-file\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.341820 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-registration-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.341820 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341707 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:56.341820 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-conf-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.341820 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c23d9d00-417f-4931-b4d3-f400c5f7c65b-host-slash\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.341820 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341781 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrpm8\" (UniqueName: \"kubernetes.io/projected/c23d9d00-417f-4931-b4d3-f400c5f7c65b-kube-api-access-mrpm8\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.341820 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-kubelet\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-lib-modules\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kng9h\" (UniqueName: \"kubernetes.io/projected/55c21cc0-e3c4-4397-aebe-73777fd14832-kube-api-access-kng9h\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2j6\" (UniqueName: \"kubernetes.io/projected/85b9bd65-e2a8-49f8-943c-f8419898584f-kube-api-access-tr2j6\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-netns\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341908 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-conf-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-kubelet\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-run\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341987 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/55c21cc0-e3c4-4397-aebe-73777fd14832-hosts-file\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.341994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-cni-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-socket-dir-parent\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342047 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-registration-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-k8s-cni-cncf-io\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342099 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-k8s-cni-cncf-io\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342141 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c23d9d00-417f-4931-b4d3-f400c5f7c65b-host-slash\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342143 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-cni-netd\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.342186 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-cnibin\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-multus-certs\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/001505d9-7034-4917-9d20-1617b28991e7-konnectivity-ca\") pod \"konnectivity-agent-kf6nh\" (UID: \"001505d9-7034-4917-9d20-1617b28991e7\") " pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-modprobe-d\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysctl-conf\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/001505d9-7034-4917-9d20-1617b28991e7-agent-certs\") pod \"konnectivity-agent-kf6nh\" (UID: \"001505d9-7034-4917-9d20-1617b28991e7\") " pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342337 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-kubelet\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342341 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-kubernetes\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-host\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-slash\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-node-log\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342405 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-kubernetes\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342422 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342445 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vdcp\" (UniqueName: \"kubernetes.io/projected/054304ea-1c6d-48fc-aaa8-8339373832c9-kube-api-access-5vdcp\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-cni-multus\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-etc-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342498 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342536 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-cni-netd\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-etc-kubernetes\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342581 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-cnibin\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-systemd-units\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovnkube-script-lib\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342621 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-multus-certs\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.342644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq9dg\" (UniqueName: \"kubernetes.io/projected/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-kube-api-access-bq9dg\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343090 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/001505d9-7034-4917-9d20-1617b28991e7-konnectivity-ca\") pod \"konnectivity-agent-kf6nh\" (UID: \"001505d9-7034-4917-9d20-1617b28991e7\") " pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343112 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-lib-modules\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edcf4db9-ad51-432f-a6a2-bf4704eefc09-cni-binary-copy\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343312 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysctl-conf\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343354 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-run-netns\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-kubelet\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343451 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-run\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343509 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-cni-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343538 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edcf4db9-ad51-432f-a6a2-bf4704eefc09-cni-binary-copy\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.343786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343557 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-socket-dir-parent\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-hostroot\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343578 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-modprobe-d\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-env-overrides\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343604 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-host\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343620 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c23d9d00-417f-4931-b4d3-f400c5f7c65b-iptables-alerter-script\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343642 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-slash\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343642 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-log-socket\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343687 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-cni-bin\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343692 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-log-socket\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovn-node-metrics-cert\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bded73a-92e1-45bf-81b3-8614cf134d27-serviceca\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp542\" (UniqueName: \"kubernetes.io/projected/9bded73a-92e1-45bf-81b3-8614cf134d27-kube-api-access-fp542\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343789 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-var-lib-kubelet\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-tuned\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-sys-fs\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-daemon-config\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.344721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bded73a-92e1-45bf-81b3-8614cf134d27-host\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysctl-d\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.343971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-systemd\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344053 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-ovn\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-sys\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b125e0b5-cd8b-4b8d-a762-4ed802533c45-tmp\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55c21cc0-e3c4-4397-aebe-73777fd14832-tmp-dir\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-cni-bin\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-var-lib-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-systemd\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-device-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-system-cni-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovnkube-config\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysconfig\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cszn7\" (UniqueName: \"kubernetes.io/projected/b125e0b5-cd8b-4b8d-a762-4ed802533c45-kube-api-access-cszn7\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344490 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-socket-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.345339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344539 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86pv2\" (UniqueName: \"kubernetes.io/projected/edcf4db9-ad51-432f-a6a2-bf4704eefc09-kube-api-access-86pv2\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-run-netns\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344674 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-hostroot\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344783 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-run-netns\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344849 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-node-log\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.344949 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-etc-selinux\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.345062 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.345154 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs podName:054304ea-1c6d-48fc-aaa8-8339373832c9 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:56.845136269 +0000 UTC m=+3.060121792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs") pod "network-metrics-daemon-fsnp7" (UID: "054304ea-1c6d-48fc-aaa8-8339373832c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345151 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-env-overrides\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345246 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysctl-d\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345250 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345290 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-systemd\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345332 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-cni-multus\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345339 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-run-ovn\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345397 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-sys\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345524 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c23d9d00-417f-4931-b4d3-f400c5f7c65b-iptables-alerter-script\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345565 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-etc-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345595 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-system-cni-dir\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.345970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345624 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-etc-kubernetes\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345669 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-systemd-units\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55c21cc0-e3c4-4397-aebe-73777fd14832-tmp-dir\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.345946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edcf4db9-ad51-432f-a6a2-bf4704eefc09-host-var-lib-cni-bin\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346014 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-var-lib-openvswitch\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346070 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-systemd\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346118 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-device-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346136 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovnkube-script-lib\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346165 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-var-lib-kubelet\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346224 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-cni-bin\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346532 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovnkube-config\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.346701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346649 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-sysconfig\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.347257 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/001505d9-7034-4917-9d20-1617b28991e7-agent-certs\") pod \"konnectivity-agent-kf6nh\" (UID: \"001505d9-7034-4917-9d20-1617b28991e7\") " pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:33:56.347257 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.346846 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.347257 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.347105 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-sys-fs\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.347257 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.347168 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85b9bd65-e2a8-49f8-943c-f8419898584f-socket-dir\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.347257 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.347232 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9bded73a-92e1-45bf-81b3-8614cf134d27-host\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.348310 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.347607 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9bded73a-92e1-45bf-81b3-8614cf134d27-serviceca\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.348310 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.347610 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edcf4db9-ad51-432f-a6a2-bf4704eefc09-multus-daemon-config\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.348446 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.348374 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b125e0b5-cd8b-4b8d-a762-4ed802533c45-tmp\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.349104 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.349084 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b125e0b5-cd8b-4b8d-a762-4ed802533c45-etc-tuned\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.349215 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.349198 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-ovn-node-metrics-cert\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.349854 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.349833 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:56.349936 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.349863 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:56.349936 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.349878 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcp5s for pod openshift-network-diagnostics/network-check-target-62kk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:56.350436 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.350405 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s podName:8a5ecaf0-889a-429b-97d3-2535af6d1be3 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:56.850383778 +0000 UTC m=+3.065369301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fcp5s" (UniqueName: "kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s") pod "network-check-target-62kk4" (UID: "8a5ecaf0-889a-429b-97d3-2535af6d1be3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:56.352242 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.352217 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2j6\" (UniqueName: \"kubernetes.io/projected/85b9bd65-e2a8-49f8-943c-f8419898584f-kube-api-access-tr2j6\") pod \"aws-ebs-csi-driver-node-l26sq\" (UID: \"85b9bd65-e2a8-49f8-943c-f8419898584f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.352338 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.352276 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrpm8\" (UniqueName: \"kubernetes.io/projected/c23d9d00-417f-4931-b4d3-f400c5f7c65b-kube-api-access-mrpm8\") pod \"iptables-alerter-p76kk\" (UID: \"c23d9d00-417f-4931-b4d3-f400c5f7c65b\") " pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.353122 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.353096 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kng9h\" (UniqueName: \"kubernetes.io/projected/55c21cc0-e3c4-4397-aebe-73777fd14832-kube-api-access-kng9h\") pod \"node-resolver-gr2bh\" (UID: \"55c21cc0-e3c4-4397-aebe-73777fd14832\") " pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.354499 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.354457 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq9dg\" (UniqueName: \"kubernetes.io/projected/f14bce2e-23e5-48b2-b1e1-a3dd87b3652a-kube-api-access-bq9dg\") pod \"ovnkube-node-rcwss\" (UID: \"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.355038 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.354965 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vdcp\" (UniqueName: \"kubernetes.io/projected/054304ea-1c6d-48fc-aaa8-8339373832c9-kube-api-access-5vdcp\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:56.355332 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.355315 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cszn7\" (UniqueName: \"kubernetes.io/projected/b125e0b5-cd8b-4b8d-a762-4ed802533c45-kube-api-access-cszn7\") pod \"tuned-x69dd\" (UID: \"b125e0b5-cd8b-4b8d-a762-4ed802533c45\") " pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.357041 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.356934 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp542\" (UniqueName: \"kubernetes.io/projected/9bded73a-92e1-45bf-81b3-8614cf134d27-kube-api-access-fp542\") pod \"node-ca-dskqq\" (UID: \"9bded73a-92e1-45bf-81b3-8614cf134d27\") " pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.357135 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.357060 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86pv2\" (UniqueName: \"kubernetes.io/projected/edcf4db9-ad51-432f-a6a2-bf4704eefc09-kube-api-access-86pv2\") pod \"multus-psvlk\" (UID: \"edcf4db9-ad51-432f-a6a2-bf4704eefc09\") " pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.443552 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.443457 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" Sep 10 02:33:56.453329 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.453304 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dskqq" Sep 10 02:33:56.469063 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.469042 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-psvlk" Sep 10 02:33:56.476769 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.476753 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:33:56.484628 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.484610 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:33:56.493431 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.493413 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x69dd" Sep 10 02:33:56.500130 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.500108 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gr2bh" Sep 10 02:33:56.508825 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.508807 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" Sep 10 02:33:56.516466 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.516444 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p76kk" Sep 10 02:33:56.597740 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.597708 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 02:33:56.748613 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.748517 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:56.748747 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.748680 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:56.748747 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.748747 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret podName:7b1b6871-29ad-4c86-8d5e-ad9470704f9e nodeName:}" failed. No retries permitted until 2026-09-10 02:33:57.748731512 +0000 UTC m=+3.963717014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret") pod "global-pull-secret-syncer-tglws" (UID: "7b1b6871-29ad-4c86-8d5e-ad9470704f9e") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:56.849573 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.849537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:56.849728 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.849688 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:56.849771 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.849754 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs podName:054304ea-1c6d-48fc-aaa8-8339373832c9 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:57.849732417 +0000 UTC m=+4.064717932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs") pod "network-metrics-daemon-fsnp7" (UID: "054304ea-1c6d-48fc-aaa8-8339373832c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:56.950595 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:56.950565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:33:56.950758 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.950739 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:56.950807 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.950762 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:56.950807 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.950778 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcp5s for pod openshift-network-diagnostics/network-check-target-62kk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:56.950876 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:56.950838 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s podName:8a5ecaf0-889a-429b-97d3-2535af6d1be3 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:57.95082034 +0000 UTC m=+4.165805846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcp5s" (UniqueName: "kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s") pod "network-check-target-62kk4" (UID: "8a5ecaf0-889a-429b-97d3-2535af6d1be3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:57.172861 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:57.172777 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 02:28:56 +0000 UTC" deadline="2028-04-20 00:46:25.072561688 +0000 UTC" Sep 10 02:33:57.172861 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:57.172811 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14110h12m27.899755374s" Sep 10 02:33:57.353442 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:57.353220 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c21cc0_e3c4_4397_aebe_73777fd14832.slice/crio-92d93d515e88feb0817f52936abc381006463cf6b209de0949dc9a2117ac4177 WatchSource:0}: Error finding container 92d93d515e88feb0817f52936abc381006463cf6b209de0949dc9a2117ac4177: Status 404 returned error can't find the container with id 92d93d515e88feb0817f52936abc381006463cf6b209de0949dc9a2117ac4177 Sep 10 02:33:57.354876 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:57.354850 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bded73a_92e1_45bf_81b3_8614cf134d27.slice/crio-7bb668abe4b080be3938f4fa2c11a433c523dd79da4c55b0b6f31de62d907f2f WatchSource:0}: Error finding container 7bb668abe4b080be3938f4fa2c11a433c523dd79da4c55b0b6f31de62d907f2f: Status 404 returned error can't find the container with id 7bb668abe4b080be3938f4fa2c11a433c523dd79da4c55b0b6f31de62d907f2f Sep 10 02:33:57.357783 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:57.357756 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14bce2e_23e5_48b2_b1e1_a3dd87b3652a.slice/crio-4cca84a23818363b849e14cf0cd797060a18ac2347d72854b07f8faea365ae30 WatchSource:0}: Error finding container 4cca84a23818363b849e14cf0cd797060a18ac2347d72854b07f8faea365ae30: Status 404 returned error can't find the container with id 4cca84a23818363b849e14cf0cd797060a18ac2347d72854b07f8faea365ae30 Sep 10 02:33:57.358757 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:57.358720 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001505d9_7034_4917_9d20_1617b28991e7.slice/crio-65cc783c705d3221d3dea0c0a19631b21e28a1830e0c42fd85c08194a74a0860 WatchSource:0}: Error finding container 65cc783c705d3221d3dea0c0a19631b21e28a1830e0c42fd85c08194a74a0860: Status 404 returned error can't find the container with id 65cc783c705d3221d3dea0c0a19631b21e28a1830e0c42fd85c08194a74a0860 Sep 10 02:33:57.359724 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:57.359701 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedcf4db9_ad51_432f_a6a2_bf4704eefc09.slice/crio-4eb69ef109c32135a2d63adb4dcfeaf68b7c073dd94e255008c51102563730fc WatchSource:0}: Error finding container 4eb69ef109c32135a2d63adb4dcfeaf68b7c073dd94e255008c51102563730fc: Status 404 returned error can't find the container with id 4eb69ef109c32135a2d63adb4dcfeaf68b7c073dd94e255008c51102563730fc Sep 10 02:33:57.361974 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:57.361903 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b9bd65_e2a8_49f8_943c_f8419898584f.slice/crio-afa2ac8643701dd9b7482c9c44c47dc6edf319888d22e03c14afd2e2f98ff1a0 WatchSource:0}: Error finding container afa2ac8643701dd9b7482c9c44c47dc6edf319888d22e03c14afd2e2f98ff1a0: Status 404 returned error can't find the container with id afa2ac8643701dd9b7482c9c44c47dc6edf319888d22e03c14afd2e2f98ff1a0 Sep 10 02:33:57.362830 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:57.362607 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23d9d00_417f_4931_b4d3_f400c5f7c65b.slice/crio-0272c1e0cf1fae07671587a13e548c3e8356fb5a0e0c6cabbafd9d27c719715a WatchSource:0}: Error finding container 0272c1e0cf1fae07671587a13e548c3e8356fb5a0e0c6cabbafd9d27c719715a: Status 404 returned error can't find the container with id 0272c1e0cf1fae07671587a13e548c3e8356fb5a0e0c6cabbafd9d27c719715a Sep 10 02:33:57.363701 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:33:57.363587 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb125e0b5_cd8b_4b8d_a762_4ed802533c45.slice/crio-e1b62add1560f31cecc1fe234ea230e2a805146f7b610b81f4e3d2edb7d7f1c2 WatchSource:0}: Error finding container e1b62add1560f31cecc1fe234ea230e2a805146f7b610b81f4e3d2edb7d7f1c2: Status 404 returned error can't find the container with id e1b62add1560f31cecc1fe234ea230e2a805146f7b610b81f4e3d2edb7d7f1c2 Sep 10 02:33:57.756163 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:57.756094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:57.756305 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:57.756246 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:57.756358 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:57.756308 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret podName:7b1b6871-29ad-4c86-8d5e-ad9470704f9e nodeName:}" failed. No retries permitted until 2026-09-10 02:33:59.756291453 +0000 UTC m=+5.971276954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret") pod "global-pull-secret-syncer-tglws" (UID: "7b1b6871-29ad-4c86-8d5e-ad9470704f9e") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:57.857435 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:57.857379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:57.857607 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:57.857504 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:57.857607 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:57.857572 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs podName:054304ea-1c6d-48fc-aaa8-8339373832c9 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:59.85755364 +0000 UTC m=+6.072539154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs") pod "network-metrics-daemon-fsnp7" (UID: "054304ea-1c6d-48fc-aaa8-8339373832c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:57.959003 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:57.958557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:33:57.959003 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:57.958710 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:57.959003 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:57.958730 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:57.959003 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:57.958741 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcp5s for pod openshift-network-diagnostics/network-check-target-62kk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:57.959003 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:57.958792 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s podName:8a5ecaf0-889a-429b-97d3-2535af6d1be3 nodeName:}" failed. No retries permitted until 2026-09-10 02:33:59.958775936 +0000 UTC m=+6.173761451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcp5s" (UniqueName: "kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s") pod "network-check-target-62kk4" (UID: "8a5ecaf0-889a-429b-97d3-2535af6d1be3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:58.173663 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.173560 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 02:28:56 +0000 UTC" deadline="2028-02-28 01:05:48.254378834 +0000 UTC" Sep 10 02:33:58.173663 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.173614 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12862h31m50.080768145s" Sep 10 02:33:58.261894 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.261869 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:58.262059 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:58.262008 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:33:58.262059 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.262033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:58.262178 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:58.262140 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:33:58.262232 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.262216 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:33:58.262379 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:58.262282 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:33:58.281941 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.281894 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" event={"ID":"85b9bd65-e2a8-49f8-943c-f8419898584f","Type":"ContainerStarted","Data":"afa2ac8643701dd9b7482c9c44c47dc6edf319888d22e03c14afd2e2f98ff1a0"} Sep 10 02:33:58.291174 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.291148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-psvlk" event={"ID":"edcf4db9-ad51-432f-a6a2-bf4704eefc09","Type":"ContainerStarted","Data":"4eb69ef109c32135a2d63adb4dcfeaf68b7c073dd94e255008c51102563730fc"} Sep 10 02:33:58.306333 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.306307 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"4cca84a23818363b849e14cf0cd797060a18ac2347d72854b07f8faea365ae30"} Sep 10 02:33:58.318016 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.317986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dskqq" event={"ID":"9bded73a-92e1-45bf-81b3-8614cf134d27","Type":"ContainerStarted","Data":"7bb668abe4b080be3938f4fa2c11a433c523dd79da4c55b0b6f31de62d907f2f"} Sep 10 02:33:58.328006 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.327979 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gr2bh" event={"ID":"55c21cc0-e3c4-4397-aebe-73777fd14832","Type":"ContainerStarted","Data":"92d93d515e88feb0817f52936abc381006463cf6b209de0949dc9a2117ac4177"} Sep 10 02:33:58.335694 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.335667 2559 generic.go:356] "Generic (PLEG): container finished" podID="eaeb717ed3add7fed81b6d35171dc301" containerID="ae520af35f4c802d5cb510a0e51d5a851c1fd64ed2541c6a16c2d9192ce6f9ef" exitCode=0 Sep 10 02:33:58.335800 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.335754 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" event={"ID":"eaeb717ed3add7fed81b6d35171dc301","Type":"ContainerDied","Data":"ae520af35f4c802d5cb510a0e51d5a851c1fd64ed2541c6a16c2d9192ce6f9ef"} Sep 10 02:33:58.343041 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.342967 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" event={"ID":"43c6e8f9bb9c38ea54330318f6fcad24","Type":"ContainerStarted","Data":"8b0a852c12767e90a59cc4a8f655684b86f954d11deac9d0ccf891924f8dbc03"} Sep 10 02:33:58.361096 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.361068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" event={"ID":"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538","Type":"ContainerStarted","Data":"97da570c34f33bdf66d77a277246b660aeec6f8197750eaca9c844a140b4d70f"} Sep 10 02:33:58.367228 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.367091 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-27.ec2.internal" podStartSLOduration=3.367071359 podStartE2EDuration="3.367071359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:33:58.366438871 +0000 UTC m=+4.581424395" watchObservedRunningTime="2026-09-10 02:33:58.367071359 +0000 UTC m=+4.582056884" Sep 10 02:33:58.383505 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.383476 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kf6nh" event={"ID":"001505d9-7034-4917-9d20-1617b28991e7","Type":"ContainerStarted","Data":"65cc783c705d3221d3dea0c0a19631b21e28a1830e0c42fd85c08194a74a0860"} Sep 10 02:33:58.389211 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.389184 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x69dd" event={"ID":"b125e0b5-cd8b-4b8d-a762-4ed802533c45","Type":"ContainerStarted","Data":"e1b62add1560f31cecc1fe234ea230e2a805146f7b610b81f4e3d2edb7d7f1c2"} Sep 10 02:33:58.397244 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:58.397187 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p76kk" event={"ID":"c23d9d00-417f-4931-b4d3-f400c5f7c65b","Type":"ContainerStarted","Data":"0272c1e0cf1fae07671587a13e548c3e8356fb5a0e0c6cabbafd9d27c719715a"} Sep 10 02:33:59.417797 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:59.417758 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" event={"ID":"eaeb717ed3add7fed81b6d35171dc301","Type":"ContainerStarted","Data":"4faa408136de2c4981486f6ccb94f21c1f1d050d2e05ba675a4c4247aeabde4b"} Sep 10 02:33:59.775475 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:59.774814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:33:59.775475 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:59.775017 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:59.775475 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:59.775075 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret podName:7b1b6871-29ad-4c86-8d5e-ad9470704f9e nodeName:}" failed. No retries permitted until 2026-09-10 02:34:03.775056437 +0000 UTC m=+9.990041944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret") pod "global-pull-secret-syncer-tglws" (UID: "7b1b6871-29ad-4c86-8d5e-ad9470704f9e") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:33:59.876433 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:59.875868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:33:59.876433 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:59.876039 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:59.876433 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:59.876100 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs podName:054304ea-1c6d-48fc-aaa8-8339373832c9 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:03.876081491 +0000 UTC m=+10.091066994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs") pod "network-metrics-daemon-fsnp7" (UID: "054304ea-1c6d-48fc-aaa8-8339373832c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:33:59.977768 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:33:59.977168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:33:59.977768 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:59.977308 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:33:59.977768 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:59.977326 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:33:59.977768 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:59.977339 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcp5s for pod openshift-network-diagnostics/network-check-target-62kk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:33:59.977768 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:33:59.977394 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s podName:8a5ecaf0-889a-429b-97d3-2535af6d1be3 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:03.977377127 +0000 UTC m=+10.192362643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcp5s" (UniqueName: "kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s") pod "network-check-target-62kk4" (UID: "8a5ecaf0-889a-429b-97d3-2535af6d1be3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:00.261698 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:00.261014 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:00.261698 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:00.261140 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:00.261698 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:00.261493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:00.261698 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:00.261593 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:00.265917 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:00.262478 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:00.265917 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:00.262630 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:02.260351 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:02.260314 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:02.260809 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:02.260439 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:02.260877 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:02.260837 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:02.260974 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:02.260923 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:02.261041 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:02.261009 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:02.261105 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:02.261087 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:03.807887 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:03.807846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:03.808349 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:03.808027 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:34:03.808349 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:03.808100 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret podName:7b1b6871-29ad-4c86-8d5e-ad9470704f9e nodeName:}" failed. No retries permitted until 2026-09-10 02:34:11.808080347 +0000 UTC m=+18.023065862 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret") pod "global-pull-secret-syncer-tglws" (UID: "7b1b6871-29ad-4c86-8d5e-ad9470704f9e") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:34:03.908968 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:03.908426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:03.908968 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:03.908574 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:34:03.908968 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:03.908637 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs podName:054304ea-1c6d-48fc-aaa8-8339373832c9 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:11.908619132 +0000 UTC m=+18.123604650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs") pod "network-metrics-daemon-fsnp7" (UID: "054304ea-1c6d-48fc-aaa8-8339373832c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:34:04.009095 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:04.009007 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:04.009262 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:04.009135 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:34:04.009262 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:04.009153 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:34:04.009262 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:04.009165 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcp5s for pod openshift-network-diagnostics/network-check-target-62kk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:04.009262 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:04.009221 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s podName:8a5ecaf0-889a-429b-97d3-2535af6d1be3 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:12.009204346 +0000 UTC m=+18.224189848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcp5s" (UniqueName: "kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s") pod "network-check-target-62kk4" (UID: "8a5ecaf0-889a-429b-97d3-2535af6d1be3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:04.260833 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:04.260759 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:04.260997 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:04.260853 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:04.260997 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:04.260959 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:04.261105 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:04.261077 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:04.261192 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:04.261120 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:04.261251 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:04.261225 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:06.261371 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:06.260676 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:06.261371 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:06.260796 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:06.261371 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:06.261215 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:06.261371 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:06.261319 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:06.262009 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:06.261487 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:06.262009 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:06.261594 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:08.260901 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:08.260620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:08.261326 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:08.260629 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:08.261326 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:08.260976 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:08.261326 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:08.260654 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:08.261326 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:08.261070 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:08.261326 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:08.261121 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:10.260676 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:10.260644 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:10.261135 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:10.260644 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:10.261135 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:10.260848 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:10.261135 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:10.260747 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:10.261135 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:10.260941 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:10.261135 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:10.261059 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:11.868899 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:11.868856 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:11.869440 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:11.868996 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:34:11.869440 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:11.869064 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret podName:7b1b6871-29ad-4c86-8d5e-ad9470704f9e nodeName:}" failed. No retries permitted until 2026-09-10 02:34:27.869045683 +0000 UTC m=+34.084031184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret") pod "global-pull-secret-syncer-tglws" (UID: "7b1b6871-29ad-4c86-8d5e-ad9470704f9e") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:34:11.969419 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:11.969323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:11.969587 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:11.969493 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:34:11.969587 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:11.969567 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs podName:054304ea-1c6d-48fc-aaa8-8339373832c9 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:27.969546404 +0000 UTC m=+34.184531921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs") pod "network-metrics-daemon-fsnp7" (UID: "054304ea-1c6d-48fc-aaa8-8339373832c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:34:12.070561 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:12.070526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:12.070735 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:12.070714 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:34:12.070793 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:12.070742 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:34:12.070793 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:12.070755 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcp5s for pod openshift-network-diagnostics/network-check-target-62kk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:12.070878 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:12.070818 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s podName:8a5ecaf0-889a-429b-97d3-2535af6d1be3 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:28.070800248 +0000 UTC m=+34.285785752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcp5s" (UniqueName: "kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s") pod "network-check-target-62kk4" (UID: "8a5ecaf0-889a-429b-97d3-2535af6d1be3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:12.260529 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:12.260455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:12.260687 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:12.260455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:12.260687 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:12.260588 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:12.260687 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:12.260462 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:12.260854 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:12.260693 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:12.260854 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:12.260727 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:14.260879 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:14.260845 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:14.261335 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:14.260959 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:14.261417 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:14.261348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:14.261473 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:14.261458 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:14.261532 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:14.261514 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:14.261607 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:14.261581 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:15.450170 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.449986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gr2bh" event={"ID":"55c21cc0-e3c4-4397-aebe-73777fd14832","Type":"ContainerStarted","Data":"e0063f4f86c78196580112f6519b44d51b70db8c2ca2ce861db0929d6f356075"} Sep 10 02:34:15.451499 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.451471 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0784fe7-0641-4c4f-b6c8-b82c0f1ab538" containerID="f29c6715550b06620c5d15ee8653291f2967091577b50a1547ad9705de585172" exitCode=0 Sep 10 02:34:15.451591 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.451547 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" event={"ID":"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538","Type":"ContainerDied","Data":"f29c6715550b06620c5d15ee8653291f2967091577b50a1547ad9705de585172"} Sep 10 02:34:15.452996 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.452976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kf6nh" event={"ID":"001505d9-7034-4917-9d20-1617b28991e7","Type":"ContainerStarted","Data":"6c0faf1e916f503ab1d0e9bb95b30a92bbf7f960095dc0e1fda305f0588bb0df"} Sep 10 02:34:15.456125 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.454989 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x69dd" event={"ID":"b125e0b5-cd8b-4b8d-a762-4ed802533c45","Type":"ContainerStarted","Data":"319e56a65da01e5956ab310d0f60ed2bf0208be4f483d5be8324e7d1482c3bf2"} Sep 10 02:34:15.459319 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.459293 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" event={"ID":"85b9bd65-e2a8-49f8-943c-f8419898584f","Type":"ContainerStarted","Data":"1886c0664a8791a218f8ff375bda4b04b4b9f57c54d903edd2b2773d48c728f4"} Sep 10 02:34:15.461100 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.461044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-psvlk" event={"ID":"edcf4db9-ad51-432f-a6a2-bf4704eefc09","Type":"ContainerStarted","Data":"033dc916eebf65fbc924e307be52cbac2605942dfa194e5579e0325299594e54"} Sep 10 02:34:15.463610 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.463587 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"b25a675f766fab7649a93e85cad15ddbc600d2d6acadd04a371c22f13c57d2d0"} Sep 10 02:34:15.463703 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.463635 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"93145bc4182bdfb60e101d8b309dbdfaf2843032493c8ba59d03ebfd3eb21163"} Sep 10 02:34:15.463703 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.463669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"e844a4c2286107196c54b800259c9c490d51d27a52aff7b031bb6b815ec7b0cf"} Sep 10 02:34:15.463815 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.463714 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"f56e465357f74cfb97cc888cbfc5f0e7b00145f816974b4283ba65817e21b62b"} Sep 10 02:34:15.464971 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.464953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dskqq" event={"ID":"9bded73a-92e1-45bf-81b3-8614cf134d27","Type":"ContainerStarted","Data":"36434a6f977f8627289a811a8d0d2ab35c98d5a7da5000a7b48023d0c0ae9173"} Sep 10 02:34:15.466114 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.466076 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gr2bh" podStartSLOduration=3.867515269 podStartE2EDuration="21.466065878s" totalImagesPullingTime="17.598550609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:15.46600409 +0000 UTC m=+21.680989612" watchObservedRunningTime="2026-09-10 02:34:15.466065878 +0000 UTC m=+21.681051401" Sep 10 02:34:15.466427 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.466408 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-27.ec2.internal" podStartSLOduration=20.466402657 podStartE2EDuration="20.466402657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:33:59.432126814 +0000 UTC m=+5.647112338" watchObservedRunningTime="2026-09-10 02:34:15.466402657 +0000 UTC m=+21.681388190" Sep 10 02:34:15.499648 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.499613 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-psvlk" podStartSLOduration=3.843607488 podStartE2EDuration="21.499602022s" totalImagesPullingTime="17.655994534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:15.499445341 +0000 UTC m=+21.714430876" watchObservedRunningTime="2026-09-10 02:34:15.499602022 +0000 UTC m=+21.714587542" Sep 10 02:34:15.515388 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.515351 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kf6nh" podStartSLOduration=3.929248819 podStartE2EDuration="21.515340102s" totalImagesPullingTime="17.586091283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:15.51501441 +0000 UTC m=+21.729999933" watchObservedRunningTime="2026-09-10 02:34:15.515340102 +0000 UTC m=+21.730325625" Sep 10 02:34:15.533320 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.533282 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dskqq" podStartSLOduration=3.943339566 podStartE2EDuration="21.533271063s" totalImagesPullingTime="17.589931497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:15.533258876 +0000 UTC m=+21.748244399" watchObservedRunningTime="2026-09-10 02:34:15.533271063 +0000 UTC m=+21.748256588" Sep 10 02:34:15.550701 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:15.550671 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x69dd" podStartSLOduration=3.9423824549999997 podStartE2EDuration="21.550656593s" totalImagesPullingTime="17.608274138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:15.550602739 +0000 UTC m=+21.765588261" watchObservedRunningTime="2026-09-10 02:34:15.550656593 +0000 UTC m=+21.765642122" Sep 10 02:34:16.261152 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:16.261076 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:16.261294 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:16.261074 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:16.261294 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:16.261225 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:16.261294 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:16.261191 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:16.261457 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:16.261356 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:16.261511 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:16.261483 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:16.470868 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:16.470247 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p76kk" event={"ID":"c23d9d00-417f-4931-b4d3-f400c5f7c65b","Type":"ContainerStarted","Data":"b813b846d20a57d715be26dc86976d96e29cceedb525d408a17204db3db69a65"} Sep 10 02:34:16.475675 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:16.475645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"cdbfad98566407fa4b6638ac931faa1c02c687c2e8c29eae8043bd85b8006a36"} Sep 10 02:34:16.475789 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:16.475724 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"a688db43b2e2e3058d95e6cc8f433f33804517541ee33c17fdcaecf239db0ec5"} Sep 10 02:34:16.486275 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:16.486226 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p76kk" podStartSLOduration=4.900919525 podStartE2EDuration="22.486207372s" totalImagesPullingTime="17.585287847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:16.485390187 +0000 UTC m=+22.700375707" watchObservedRunningTime="2026-09-10 02:34:16.486207372 +0000 UTC m=+22.701192896" Sep 10 02:34:16.577105 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:16.577077 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 02:34:17.199702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:17.199352 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T02:34:16.577096737Z","UUID":"13bc91e3-42c9-47be-884d-522fdf36eb24","Handler":null,"Name":"","Endpoint":""} Sep 10 02:34:17.201040 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:17.201000 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 02:34:17.201040 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:17.201035 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 02:34:17.481264 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:17.481186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" event={"ID":"85b9bd65-e2a8-49f8-943c-f8419898584f","Type":"ContainerStarted","Data":"ef642b135316b54cb89778db226f1abc752990be0f22c42b77b1a51486c76b2c"} Sep 10 02:34:18.261124 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:18.261100 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:18.261363 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:18.261100 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:18.261363 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:18.261241 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:18.261363 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:18.261334 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:18.261363 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:18.261100 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:18.261588 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:18.261450 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:18.485257 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:18.485196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" event={"ID":"85b9bd65-e2a8-49f8-943c-f8419898584f","Type":"ContainerStarted","Data":"f1d410ab8dd899e43681676b6ec9e0a7ca2b25482ac54dc04876696e55b72d8c"} Sep 10 02:34:18.488384 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:18.488359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"35e11b5bd41c01bae491f95b5f4907fa121588beddb3fc868d80ce584008d42e"} Sep 10 02:34:18.947483 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:18.947456 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:34:18.948087 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:18.948065 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:34:18.963674 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:18.963624 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l26sq" podStartSLOduration=4.479024559 podStartE2EDuration="24.963605213s" totalImagesPullingTime="20.484580654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:18.502765831 +0000 UTC m=+24.717751354" watchObservedRunningTime="2026-09-10 02:34:18.963605213 +0000 UTC m=+25.178590737" Sep 10 02:34:19.490649 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:19.490616 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:34:19.491324 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:19.491304 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kf6nh" Sep 10 02:34:20.260856 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:20.260781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:20.260856 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:20.260817 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:20.261341 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:20.261163 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:20.261527 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:20.261504 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:20.261859 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:20.261831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:20.262312 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:20.262254 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:21.498697 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:21.498400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" event={"ID":"f14bce2e-23e5-48b2-b1e1-a3dd87b3652a","Type":"ContainerStarted","Data":"adca05df694a6c7c2a42b020389f9deb744e88449e2aee01f88d8fa91d9a73fb"} Sep 10 02:34:21.498697 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:21.498687 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:34:21.499210 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:21.498743 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:34:21.500806 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:21.500773 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0784fe7-0641-4c4f-b6c8-b82c0f1ab538" containerID="d60292506ecaaeaf1627333f761d3cab690a63f9b5a4357d0449878c83ec81f4" exitCode=0 Sep 10 02:34:21.500901 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:21.500858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" event={"ID":"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538","Type":"ContainerDied","Data":"d60292506ecaaeaf1627333f761d3cab690a63f9b5a4357d0449878c83ec81f4"} Sep 10 02:34:21.514893 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:21.514872 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:34:21.527338 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:21.527298 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" podStartSLOduration=9.880356621 podStartE2EDuration="27.527285426s" totalImagesPullingTime="17.646928805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:21.52547622 +0000 UTC m=+27.740461743" watchObservedRunningTime="2026-09-10 02:34:21.527285426 +0000 UTC m=+27.742270948" Sep 10 02:34:22.261135 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:22.261104 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:22.261287 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:22.261104 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:22.261287 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:22.261200 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:22.261287 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:22.261229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:22.261436 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:22.261342 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:22.261491 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:22.261428 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:22.503550 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:22.503525 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:34:22.518319 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:22.518270 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:34:23.507803 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:23.507766 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0784fe7-0641-4c4f-b6c8-b82c0f1ab538" containerID="c20c7aaf7ce3c4e269536e37315d8f50d273f3479386456b0b9737fd35cd62bd" exitCode=0 Sep 10 02:34:23.508279 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:23.507860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" event={"ID":"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538","Type":"ContainerDied","Data":"c20c7aaf7ce3c4e269536e37315d8f50d273f3479386456b0b9737fd35cd62bd"} Sep 10 02:34:24.263237 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:24.263211 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:24.263408 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:24.263296 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:24.263408 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:24.263300 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:24.263408 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:24.263328 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:24.263559 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:24.263421 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:24.263559 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:24.263506 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:25.517350 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:25.517313 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0784fe7-0641-4c4f-b6c8-b82c0f1ab538" containerID="62961fd5a205de0e8b9bc264e2d716729fd6f3a3884525f2679e8167368fc8d1" exitCode=0 Sep 10 02:34:25.517817 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:25.517363 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" event={"ID":"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538","Type":"ContainerDied","Data":"62961fd5a205de0e8b9bc264e2d716729fd6f3a3884525f2679e8167368fc8d1"} Sep 10 02:34:26.263271 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:26.263233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:26.263271 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:26.263260 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:26.263456 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:26.263262 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:26.263456 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:26.263351 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:26.263456 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:26.263425 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:26.263585 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:26.263539 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:27.889191 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:27.889159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:27.889664 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:27.889304 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 02:34:27.889664 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:27.889371 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret podName:7b1b6871-29ad-4c86-8d5e-ad9470704f9e nodeName:}" failed. No retries permitted until 2026-09-10 02:34:59.889350657 +0000 UTC m=+66.104336181 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret") pod "global-pull-secret-syncer-tglws" (UID: "7b1b6871-29ad-4c86-8d5e-ad9470704f9e") : object "kube-system"/"original-pull-secret" not registered Sep 10 02:34:27.989537 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:27.989506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:27.989673 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:27.989640 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:34:27.989720 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:27.989705 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs podName:054304ea-1c6d-48fc-aaa8-8339373832c9 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:59.989684799 +0000 UTC m=+66.204670301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs") pod "network-metrics-daemon-fsnp7" (UID: "054304ea-1c6d-48fc-aaa8-8339373832c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 02:34:28.089786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:28.089749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:28.089918 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:28.089877 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 02:34:28.089918 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:28.089890 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 02:34:28.089918 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:28.089898 2559 projected.go:196] Error preparing data for projected volume kube-api-access-fcp5s for pod openshift-network-diagnostics/network-check-target-62kk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:28.090059 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:28.089954 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s podName:8a5ecaf0-889a-429b-97d3-2535af6d1be3 nodeName:}" failed. No retries permitted until 2026-09-10 02:35:00.089942656 +0000 UTC m=+66.304928170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcp5s" (UniqueName: "kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s") pod "network-check-target-62kk4" (UID: "8a5ecaf0-889a-429b-97d3-2535af6d1be3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 02:34:28.260612 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:28.260536 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:28.260736 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:28.260663 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:28.260736 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:28.260701 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:28.260852 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:28.260769 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:28.260852 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:28.260843 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:28.260972 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:28.260949 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:30.260304 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:30.260273 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:30.260304 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:30.260290 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:30.260856 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:30.260413 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:30.260856 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:30.260463 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:30.260856 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:30.260508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:30.260856 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:30.260579 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:31.535451 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:31.535419 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0784fe7-0641-4c4f-b6c8-b82c0f1ab538" containerID="221c77dfeda8fd767effd48b267c6bfeb398833265221ab94382b488e3ab5df0" exitCode=0 Sep 10 02:34:31.535797 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:31.535492 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" event={"ID":"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538","Type":"ContainerDied","Data":"221c77dfeda8fd767effd48b267c6bfeb398833265221ab94382b488e3ab5df0"} Sep 10 02:34:32.261336 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.261180 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:32.261496 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.261187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:32.261549 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.261187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:32.261596 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:32.261546 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:32.261596 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:32.261412 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:32.261671 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:32.261586 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:32.541005 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.540913 2559 generic.go:356] "Generic (PLEG): container finished" podID="a0784fe7-0641-4c4f-b6c8-b82c0f1ab538" containerID="bc78325667557ef04a9881c8ba9041c66dc77f5811d29aba1045a14bfa0c0e94" exitCode=0 Sep 10 02:34:32.541005 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.540964 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" event={"ID":"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538","Type":"ContainerDied","Data":"bc78325667557ef04a9881c8ba9041c66dc77f5811d29aba1045a14bfa0c0e94"} Sep 10 02:34:32.583429 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.583396 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-62kk4"] Sep 10 02:34:32.583539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.583491 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:32.583606 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:32.583585 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:32.590815 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.590791 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tglws"] Sep 10 02:34:32.590957 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.590876 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:32.591024 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:32.590985 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:32.592533 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.592510 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fsnp7"] Sep 10 02:34:32.592869 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:32.592595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:32.592869 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:32.592688 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:33.546940 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:33.546899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" event={"ID":"a0784fe7-0641-4c4f-b6c8-b82c0f1ab538","Type":"ContainerStarted","Data":"436ce66a549a8a37c687f85d820b20203ceda72826e7758e4083c6ffb1ce8732"} Sep 10 02:34:33.570569 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:33.570528 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ltlr4" podStartSLOduration=8.984065924 podStartE2EDuration="39.570503753s" totalImagesPullingTime="30.586437829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:33.56900357 +0000 UTC m=+39.783989093" watchObservedRunningTime="2026-09-10 02:34:33.570503753 +0000 UTC m=+39.785489277" Sep 10 02:34:34.262607 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:34.262387 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:34.262767 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:34.262473 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:34.262767 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:34.262692 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:34.262767 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:34.262518 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:34.262960 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:34.262772 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:34.262960 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:34.262862 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:36.260477 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.260443 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:36.260477 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.260458 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:36.260477 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.260474 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:36.260975 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:36.260544 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tglws" podUID="7b1b6871-29ad-4c86-8d5e-ad9470704f9e" Sep 10 02:34:36.260975 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:36.260630 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsnp7" podUID="054304ea-1c6d-48fc-aaa8-8339373832c9" Sep 10 02:34:36.260975 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:36.260757 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-62kk4" podUID="8a5ecaf0-889a-429b-97d3-2535af6d1be3" Sep 10 02:34:36.533425 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.533370 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-27.ec2.internal" event="NodeReady" Sep 10 02:34:36.533532 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.533500 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 02:34:36.583440 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.583419 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-chsmv"] Sep 10 02:34:36.605136 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.605109 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n8lqg"] Sep 10 02:34:36.605268 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.605248 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chsmv" Sep 10 02:34:36.607732 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.607706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v9q4l\"" Sep 10 02:34:36.607732 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.607703 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 02:34:36.607896 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.607744 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 02:34:36.607896 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.607763 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 02:34:36.623127 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.623104 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chsmv"] Sep 10 02:34:36.623225 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.623133 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n8lqg"] Sep 10 02:34:36.623225 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.623159 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bnskt"] Sep 10 02:34:36.623225 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.623212 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.625908 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.625888 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 02:34:36.626040 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.626007 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g9mpm\"" Sep 10 02:34:36.626040 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.626033 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 02:34:36.626165 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.626148 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 02:34:36.626241 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.626156 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 02:34:36.636003 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.635986 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bnskt"] Sep 10 02:34:36.636085 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.636070 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.638297 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.638282 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 02:34:36.638579 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.638567 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 02:34:36.638646 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.638634 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4fcfm\"" Sep 10 02:34:36.753681 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqv82\" (UniqueName: \"kubernetes.io/projected/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-kube-api-access-nqv82\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.753758 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99209777-b12f-42f4-92d7-07c926cc1725-crio-socket\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.753758 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753704 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99209777-b12f-42f4-92d7-07c926cc1725-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.753758 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dckxb\" (UniqueName: \"kubernetes.io/projected/99209777-b12f-42f4-92d7-07c926cc1725-kube-api-access-dckxb\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.753868 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3723a4ec-174f-496b-8935-5c280e4796d9-cert\") pod \"ingress-canary-chsmv\" (UID: \"3723a4ec-174f-496b-8935-5c280e4796d9\") " pod="openshift-ingress-canary/ingress-canary-chsmv" Sep 10 02:34:36.753868 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-config-volume\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.753868 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-metrics-tls\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.753983 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77n8c\" (UniqueName: \"kubernetes.io/projected/3723a4ec-174f-496b-8935-5c280e4796d9-kube-api-access-77n8c\") pod \"ingress-canary-chsmv\" (UID: \"3723a4ec-174f-496b-8935-5c280e4796d9\") " pod="openshift-ingress-canary/ingress-canary-chsmv" Sep 10 02:34:36.753983 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-tmp-dir\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.753983 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753943 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99209777-b12f-42f4-92d7-07c926cc1725-data-volume\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.753983 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.753958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99209777-b12f-42f4-92d7-07c926cc1725-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.854963 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.854901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77n8c\" (UniqueName: \"kubernetes.io/projected/3723a4ec-174f-496b-8935-5c280e4796d9-kube-api-access-77n8c\") pod \"ingress-canary-chsmv\" (UID: \"3723a4ec-174f-496b-8935-5c280e4796d9\") " pod="openshift-ingress-canary/ingress-canary-chsmv" Sep 10 02:34:36.854963 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.854944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-tmp-dir\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.855079 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.854987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99209777-b12f-42f4-92d7-07c926cc1725-data-volume\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.855079 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99209777-b12f-42f4-92d7-07c926cc1725-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.855079 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv82\" (UniqueName: \"kubernetes.io/projected/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-kube-api-access-nqv82\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.855215 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855178 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99209777-b12f-42f4-92d7-07c926cc1725-crio-socket\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.855215 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99209777-b12f-42f4-92d7-07c926cc1725-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.855316 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dckxb\" (UniqueName: \"kubernetes.io/projected/99209777-b12f-42f4-92d7-07c926cc1725-kube-api-access-dckxb\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.855316 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855273 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3723a4ec-174f-496b-8935-5c280e4796d9-cert\") pod \"ingress-canary-chsmv\" (UID: \"3723a4ec-174f-496b-8935-5c280e4796d9\") " pod="openshift-ingress-canary/ingress-canary-chsmv" Sep 10 02:34:36.855316 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855299 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-config-volume\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.855463 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-metrics-tls\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.855463 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-tmp-dir\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.855463 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855439 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/99209777-b12f-42f4-92d7-07c926cc1725-crio-socket\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.855463 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855449 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/99209777-b12f-42f4-92d7-07c926cc1725-data-volume\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.855982 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855957 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-config-volume\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.856099 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.855978 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/99209777-b12f-42f4-92d7-07c926cc1725-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.859321 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.859293 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/99209777-b12f-42f4-92d7-07c926cc1725-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.859321 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.859315 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-metrics-tls\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.859514 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.859496 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3723a4ec-174f-496b-8935-5c280e4796d9-cert\") pod \"ingress-canary-chsmv\" (UID: \"3723a4ec-174f-496b-8935-5c280e4796d9\") " pod="openshift-ingress-canary/ingress-canary-chsmv" Sep 10 02:34:36.863286 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.863254 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dckxb\" (UniqueName: \"kubernetes.io/projected/99209777-b12f-42f4-92d7-07c926cc1725-kube-api-access-dckxb\") pod \"insights-runtime-extractor-n8lqg\" (UID: \"99209777-b12f-42f4-92d7-07c926cc1725\") " pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.863389 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.863345 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77n8c\" (UniqueName: \"kubernetes.io/projected/3723a4ec-174f-496b-8935-5c280e4796d9-kube-api-access-77n8c\") pod \"ingress-canary-chsmv\" (UID: \"3723a4ec-174f-496b-8935-5c280e4796d9\") " pod="openshift-ingress-canary/ingress-canary-chsmv" Sep 10 02:34:36.874100 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.874081 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqv82\" (UniqueName: \"kubernetes.io/projected/cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279-kube-api-access-nqv82\") pod \"dns-default-bnskt\" (UID: \"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279\") " pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:36.915136 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.915116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chsmv" Sep 10 02:34:36.931251 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.931233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n8lqg" Sep 10 02:34:36.945044 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:36.945013 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:37.231404 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:37.231380 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chsmv"] Sep 10 02:34:37.234288 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:37.234261 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n8lqg"] Sep 10 02:34:37.234728 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:37.234700 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3723a4ec_174f_496b_8935_5c280e4796d9.slice/crio-7664c31b77b82ea65973212f3fa97c14bec154a61ac941593df56011744b6862 WatchSource:0}: Error finding container 7664c31b77b82ea65973212f3fa97c14bec154a61ac941593df56011744b6862: Status 404 returned error can't find the container with id 7664c31b77b82ea65973212f3fa97c14bec154a61ac941593df56011744b6862 Sep 10 02:34:37.237923 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:37.237895 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99209777_b12f_42f4_92d7_07c926cc1725.slice/crio-49c3b8b260baa4b984f7a14b76a93e2a9cba711605681091856e598d3527c827 WatchSource:0}: Error finding container 49c3b8b260baa4b984f7a14b76a93e2a9cba711605681091856e598d3527c827: Status 404 returned error can't find the container with id 49c3b8b260baa4b984f7a14b76a93e2a9cba711605681091856e598d3527c827 Sep 10 02:34:37.253780 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:37.253758 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bnskt"] Sep 10 02:34:37.256945 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:37.256907 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf3aa85_eb4d_4c7f_b5ec_0ec89eff9279.slice/crio-9a5dab85bd65240600d4fc2f29d0807f554337fe5948ff208799dd53e8ea08a3 WatchSource:0}: Error finding container 9a5dab85bd65240600d4fc2f29d0807f554337fe5948ff208799dd53e8ea08a3: Status 404 returned error can't find the container with id 9a5dab85bd65240600d4fc2f29d0807f554337fe5948ff208799dd53e8ea08a3 Sep 10 02:34:37.556549 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:37.556480 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chsmv" event={"ID":"3723a4ec-174f-496b-8935-5c280e4796d9","Type":"ContainerStarted","Data":"7664c31b77b82ea65973212f3fa97c14bec154a61ac941593df56011744b6862"} Sep 10 02:34:37.557845 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:37.557650 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnskt" event={"ID":"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279","Type":"ContainerStarted","Data":"9a5dab85bd65240600d4fc2f29d0807f554337fe5948ff208799dd53e8ea08a3"} Sep 10 02:34:37.559232 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:37.559209 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8lqg" event={"ID":"99209777-b12f-42f4-92d7-07c926cc1725","Type":"ContainerStarted","Data":"ac37fd705efb08c2647e206842fb0c609c15276f9a796e1a754f20db92006dc8"} Sep 10 02:34:37.559325 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:37.559252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8lqg" event={"ID":"99209777-b12f-42f4-92d7-07c926cc1725","Type":"ContainerStarted","Data":"49c3b8b260baa4b984f7a14b76a93e2a9cba711605681091856e598d3527c827"} Sep 10 02:34:38.262045 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.261037 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:34:38.262045 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.261040 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:34:38.262045 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.261172 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:38.264300 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.264278 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 02:34:38.264485 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.264468 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 02:34:38.265235 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.265215 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 02:34:38.265819 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.265401 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwtct\"" Sep 10 02:34:38.265819 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.265460 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 02:34:38.265819 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:38.265673 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcpg8\"" Sep 10 02:34:39.569712 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:39.569663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8lqg" event={"ID":"99209777-b12f-42f4-92d7-07c926cc1725","Type":"ContainerStarted","Data":"50f41f73604f96d61dace17576a30e59bf2dc6414e9dee80b33b92dceed6e32c"} Sep 10 02:34:40.576966 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.576916 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n"] Sep 10 02:34:40.597754 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.597726 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n"] Sep 10 02:34:40.597894 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.597870 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" Sep 10 02:34:40.600626 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.600597 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 02:34:40.600784 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.600640 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5n5sq\"" Sep 10 02:34:40.780657 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.780588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/523369b4-d018-4d3a-b0eb-c52d6a95f33e-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-lg95n\" (UID: \"523369b4-d018-4d3a-b0eb-c52d6a95f33e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" Sep 10 02:34:40.881845 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.881813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/523369b4-d018-4d3a-b0eb-c52d6a95f33e-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-lg95n\" (UID: \"523369b4-d018-4d3a-b0eb-c52d6a95f33e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" Sep 10 02:34:40.884994 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.884969 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/523369b4-d018-4d3a-b0eb-c52d6a95f33e-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-lg95n\" (UID: \"523369b4-d018-4d3a-b0eb-c52d6a95f33e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" Sep 10 02:34:40.907793 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:40.907768 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" Sep 10 02:34:41.219198 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.219166 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n"] Sep 10 02:34:41.242455 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:41.242427 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523369b4_d018_4d3a_b0eb_c52d6a95f33e.slice/crio-64166329efe591dadfa93298d51a9ef6155b4167fee228c9bf10459e442572f6 WatchSource:0}: Error finding container 64166329efe591dadfa93298d51a9ef6155b4167fee228c9bf10459e442572f6: Status 404 returned error can't find the container with id 64166329efe591dadfa93298d51a9ef6155b4167fee228c9bf10459e442572f6 Sep 10 02:34:41.580284 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.580072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnskt" event={"ID":"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279","Type":"ContainerStarted","Data":"15583b20ed2115098dd06be34576d58229252b775943b23a893f9788478c3a91"} Sep 10 02:34:41.580284 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.580275 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnskt" event={"ID":"cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279","Type":"ContainerStarted","Data":"f14cd1bb21a007b107993d3e0ea2fe0bfd2e9ea584c16816cf1f0cd96a2d52c6"} Sep 10 02:34:41.580750 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.580308 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:41.582350 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.582325 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n8lqg" event={"ID":"99209777-b12f-42f4-92d7-07c926cc1725","Type":"ContainerStarted","Data":"ef435e8b98a79ebfa3d0cbf561e27fa3050dcc8f88562d34f292f5c0f35f5527"} Sep 10 02:34:41.584039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.584015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chsmv" event={"ID":"3723a4ec-174f-496b-8935-5c280e4796d9","Type":"ContainerStarted","Data":"d2a78bba40c517a5b4a42f016214b237e1664fb2ca6bb8c65efdf4f9cc0946ca"} Sep 10 02:34:41.585113 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.585095 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" event={"ID":"523369b4-d018-4d3a-b0eb-c52d6a95f33e","Type":"ContainerStarted","Data":"64166329efe591dadfa93298d51a9ef6155b4167fee228c9bf10459e442572f6"} Sep 10 02:34:41.597384 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.597339 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bnskt" podStartSLOduration=1.901840432 podStartE2EDuration="5.597327235s" totalImagesPullingTime="3.695486803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:41.597128112 +0000 UTC m=+47.812113635" watchObservedRunningTime="2026-09-10 02:34:41.597327235 +0000 UTC m=+47.812312752" Sep 10 02:34:41.612360 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.612326 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-chsmv" podStartSLOduration=1.888976142 podStartE2EDuration="5.612314702s" totalImagesPullingTime="3.72333856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:41.612078417 +0000 UTC m=+47.827063939" watchObservedRunningTime="2026-09-10 02:34:41.612314702 +0000 UTC m=+47.827300239" Sep 10 02:34:41.628740 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:41.628704 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n8lqg" podStartSLOduration=1.843232593 podStartE2EDuration="5.628691473s" totalImagesPullingTime="3.78545888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:34:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:41.62846164 +0000 UTC m=+47.843447163" watchObservedRunningTime="2026-09-10 02:34:41.628691473 +0000 UTC m=+47.843677001" Sep 10 02:34:43.593883 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:43.593844 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" event={"ID":"523369b4-d018-4d3a-b0eb-c52d6a95f33e","Type":"ContainerStarted","Data":"ebf1b6eb16c6eb1a0660431370d52fe8466e57b3e30e954b43a498bfaec87dcf"} Sep 10 02:34:43.594552 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:43.594121 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" Sep 10 02:34:43.599333 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:43.599310 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" Sep 10 02:34:43.609809 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:43.609761 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-lg95n" podStartSLOduration=2.073548162 podStartE2EDuration="3.609746069s" totalImagesPullingTime="1.536197907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:43.609118926 +0000 UTC m=+49.824104449" watchObservedRunningTime="2026-09-10 02:34:43.609746069 +0000 UTC m=+49.824731583" Sep 10 02:34:44.626747 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.626718 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-rqt4r"] Sep 10 02:34:44.641580 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.641556 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-rqt4r"] Sep 10 02:34:44.641722 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.641663 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.644194 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.644173 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 02:34:44.644992 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.644966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 10 02:34:44.645238 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.645217 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 02:34:44.645512 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.645493 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 10 02:34:44.645587 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.645568 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7p64z\"" Sep 10 02:34:44.646064 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.646046 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 02:34:44.708385 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.708364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.708482 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.708390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpq2c\" (UniqueName: \"kubernetes.io/projected/848eff4a-2d61-406b-8811-9809f6a4f6e6-kube-api-access-bpq2c\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.708482 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.708434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.708482 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.708470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848eff4a-2d61-406b-8811-9809f6a4f6e6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.808978 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.808945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.809084 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.808991 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpq2c\" (UniqueName: \"kubernetes.io/projected/848eff4a-2d61-406b-8811-9809f6a4f6e6-kube-api-access-bpq2c\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.809084 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:44.809006 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 10 02:34:44.809084 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:44.809056 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-tls podName:848eff4a-2d61-406b-8811-9809f6a4f6e6 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:45.309041721 +0000 UTC m=+51.524027254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-rqt4r" (UID: "848eff4a-2d61-406b-8811-9809f6a4f6e6") : secret "prometheus-operator-tls" not found Sep 10 02:34:44.809084 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.809071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.809295 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.809094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848eff4a-2d61-406b-8811-9809f6a4f6e6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.809768 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.809740 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/848eff4a-2d61-406b-8811-9809f6a4f6e6-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.812987 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.812809 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:44.820128 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:44.820108 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpq2c\" (UniqueName: \"kubernetes.io/projected/848eff4a-2d61-406b-8811-9809f6a4f6e6-kube-api-access-bpq2c\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:45.313295 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:45.313262 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:45.315772 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:45.315744 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/848eff4a-2d61-406b-8811-9809f6a4f6e6-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-rqt4r\" (UID: \"848eff4a-2d61-406b-8811-9809f6a4f6e6\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:45.559276 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:45.559246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" Sep 10 02:34:45.853069 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:45.853003 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-rqt4r"] Sep 10 02:34:45.857005 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:45.856980 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848eff4a_2d61_406b_8811_9809f6a4f6e6.slice/crio-8bdb4f3e3a7efab2c560481328a4be6671cd6ee38389c5dfd31b67f2f8297e2e WatchSource:0}: Error finding container 8bdb4f3e3a7efab2c560481328a4be6671cd6ee38389c5dfd31b67f2f8297e2e: Status 404 returned error can't find the container with id 8bdb4f3e3a7efab2c560481328a4be6671cd6ee38389c5dfd31b67f2f8297e2e Sep 10 02:34:46.408257 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.408226 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-7ppbf"] Sep 10 02:34:46.410476 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.410459 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-7ppbf" Sep 10 02:34:46.413139 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.413113 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dzkwl\"" Sep 10 02:34:46.413139 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.413132 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 02:34:46.413302 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.413187 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 02:34:46.420481 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.420461 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-294zj\" (UniqueName: \"kubernetes.io/projected/b0fe8b34-491b-48f7-8a08-297cda1a0d23-kube-api-access-294zj\") pod \"downloads-85d98c998f-7ppbf\" (UID: \"b0fe8b34-491b-48f7-8a08-297cda1a0d23\") " pod="openshift-console/downloads-85d98c998f-7ppbf" Sep 10 02:34:46.430803 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.430776 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-7ppbf"] Sep 10 02:34:46.521006 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.520973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-294zj\" (UniqueName: \"kubernetes.io/projected/b0fe8b34-491b-48f7-8a08-297cda1a0d23-kube-api-access-294zj\") pod \"downloads-85d98c998f-7ppbf\" (UID: \"b0fe8b34-491b-48f7-8a08-297cda1a0d23\") " pod="openshift-console/downloads-85d98c998f-7ppbf" Sep 10 02:34:46.530449 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.530428 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-294zj\" (UniqueName: \"kubernetes.io/projected/b0fe8b34-491b-48f7-8a08-297cda1a0d23-kube-api-access-294zj\") pod \"downloads-85d98c998f-7ppbf\" (UID: \"b0fe8b34-491b-48f7-8a08-297cda1a0d23\") " pod="openshift-console/downloads-85d98c998f-7ppbf" Sep 10 02:34:46.604830 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.604799 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" event={"ID":"848eff4a-2d61-406b-8811-9809f6a4f6e6","Type":"ContainerStarted","Data":"8bdb4f3e3a7efab2c560481328a4be6671cd6ee38389c5dfd31b67f2f8297e2e"} Sep 10 02:34:46.718619 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.718548 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-7ppbf" Sep 10 02:34:46.994744 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:46.994677 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-7ppbf"] Sep 10 02:34:47.000693 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:47.000666 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0fe8b34_491b_48f7_8a08_297cda1a0d23.slice/crio-9e1539a0c5deedc6b1be26bfd209786914edf89d9613b07481a617c0bcc087d0 WatchSource:0}: Error finding container 9e1539a0c5deedc6b1be26bfd209786914edf89d9613b07481a617c0bcc087d0: Status 404 returned error can't find the container with id 9e1539a0c5deedc6b1be26bfd209786914edf89d9613b07481a617c0bcc087d0 Sep 10 02:34:47.609590 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:47.609453 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" event={"ID":"848eff4a-2d61-406b-8811-9809f6a4f6e6","Type":"ContainerStarted","Data":"bd815b749ac92a33154224263595f26a0df307d468b28fff163400f722a541ef"} Sep 10 02:34:47.610495 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:47.610466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-7ppbf" event={"ID":"b0fe8b34-491b-48f7-8a08-297cda1a0d23","Type":"ContainerStarted","Data":"9e1539a0c5deedc6b1be26bfd209786914edf89d9613b07481a617c0bcc087d0"} Sep 10 02:34:48.616054 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:48.616011 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" event={"ID":"848eff4a-2d61-406b-8811-9809f6a4f6e6","Type":"ContainerStarted","Data":"08b54fdc896c04cd769b9d888023b7ea16c599450fabe12d87e3e367277e15fb"} Sep 10 02:34:48.634343 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:48.634289 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-rqt4r" podStartSLOduration=2.989885825 podStartE2EDuration="4.634267551s" totalImagesPullingTime="1.644381726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:48.633218606 +0000 UTC m=+54.848204326" watchObservedRunningTime="2026-09-10 02:34:48.634267551 +0000 UTC m=+54.849253076" Sep 10 02:34:51.000070 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.000029 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn"] Sep 10 02:34:51.002451 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.002422 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.005302 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.005171 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6t2q7\"" Sep 10 02:34:51.005302 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.005172 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 10 02:34:51.005302 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.005225 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 10 02:34:51.016314 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.016288 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2"] Sep 10 02:34:51.018389 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.018368 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn"] Sep 10 02:34:51.018510 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.018490 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.021084 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.021064 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 10 02:34:51.021200 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.021064 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k5wc8\"" Sep 10 02:34:51.022489 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.022468 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 10 02:34:51.022579 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.022516 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 10 02:34:51.031662 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.031644 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8k7fw"] Sep 10 02:34:51.034150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.034131 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.034282 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.034237 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2"] Sep 10 02:34:51.037795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.037773 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qwtm5\"" Sep 10 02:34:51.037890 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.037812 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 02:34:51.038029 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.038014 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 02:34:51.038117 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.038098 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 02:34:51.056299 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfce1a77-e7d9-465e-a581-c9f0538b4335-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.056409 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb2cg\" (UniqueName: \"kubernetes.io/projected/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-kube-api-access-bb2cg\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.056409 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-metrics-client-ca\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.056577 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.056577 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.056577 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-tls\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.056577 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-wtmp\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.056577 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.056577 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056559 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phk6g\" (UniqueName: \"kubernetes.io/projected/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-api-access-phk6g\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.056795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-sys\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.056795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.056795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-textfile\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.056795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.056795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056758 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-root\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.056795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056786 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.057066 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.057066 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.057066 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvjn4\" (UniqueName: \"kubernetes.io/projected/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-kube-api-access-pvjn4\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.057066 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.056967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfce1a77-e7d9-465e-a581-c9f0538b4335-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.158269 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfce1a77-e7d9-465e-a581-c9f0538b4335-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.158404 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158273 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb2cg\" (UniqueName: \"kubernetes.io/projected/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-kube-api-access-bb2cg\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158404 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158294 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-metrics-client-ca\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158404 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.158404 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.158404 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-tls\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158404 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-wtmp\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.158671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phk6g\" (UniqueName: \"kubernetes.io/projected/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-api-access-phk6g\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.158671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-sys\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.158671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-textfile\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.158671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-root\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158981 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.158981 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158677 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cfce1a77-e7d9-465e-a581-c9f0538b4335-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.158981 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.158981 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjn4\" (UniqueName: \"kubernetes.io/projected/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-kube-api-access-pvjn4\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.158981 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.158757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfce1a77-e7d9-465e-a581-c9f0538b4335-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:51.159292 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.159335 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:51.159355 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls podName:766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:51.659338722 +0000 UTC m=+57.874324227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-5dcpn" (UID: "766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41") : secret "openshift-state-metrics-tls" not found Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.159407 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-wtmp\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:51.159425 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.159434 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfce1a77-e7d9-465e-a581-c9f0538b4335-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:51.159493 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-tls podName:cfce1a77-e7d9-465e-a581-c9f0538b4335 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:51.659473043 +0000 UTC m=+57.874458546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-w9fr2" (UID: "cfce1a77-e7d9-465e-a581-c9f0538b4335") : secret "kube-state-metrics-tls" not found Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.159546 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-root\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.159759 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-metrics-client-ca\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:51.159292 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:51.159828 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-tls podName:c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:51.65981306 +0000 UTC m=+57.874798585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-tls") pod "node-exporter-8k7fw" (UID: "c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2") : secret "node-exporter-tls" not found Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.159780 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-textfile\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.159894 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-sys\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.160017 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.159899 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.160886 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.160196 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.163206 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.163180 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.163301 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.163215 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.163301 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.163185 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.170550 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.170494 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvjn4\" (UniqueName: \"kubernetes.io/projected/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-kube-api-access-pvjn4\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.170871 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.170849 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb2cg\" (UniqueName: \"kubernetes.io/projected/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-kube-api-access-bb2cg\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.171582 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.171563 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phk6g\" (UniqueName: \"kubernetes.io/projected/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-api-access-phk6g\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.591005 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.590980 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bnskt" Sep 10 02:34:51.663178 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.662438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.663178 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.662533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-tls\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.663178 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.662616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:51.663178 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:51.662750 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 10 02:34:51.663178 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:34:51.662818 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls podName:766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41 nodeName:}" failed. No retries permitted until 2026-09-10 02:34:52.662799863 +0000 UTC m=+58.877785367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-5dcpn" (UID: "766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41") : secret "openshift-state-metrics-tls" not found Sep 10 02:34:51.665466 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.665438 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfce1a77-e7d9-465e-a581-c9f0538b4335-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-w9fr2\" (UID: \"cfce1a77-e7d9-465e-a581-c9f0538b4335\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.665591 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.665486 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2-node-exporter-tls\") pod \"node-exporter-8k7fw\" (UID: \"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2\") " pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.928944 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.928893 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" Sep 10 02:34:51.946097 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:51.946070 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8k7fw" Sep 10 02:34:51.983094 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:51.983057 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc704b0b6_d96d_46e9_8a5b_a51c8c8d8bb2.slice/crio-727dee3c08150e0e6cb0050298055e6b7e97355344bc065ab0753febd85e4e0d WatchSource:0}: Error finding container 727dee3c08150e0e6cb0050298055e6b7e97355344bc065ab0753febd85e4e0d: Status 404 returned error can't find the container with id 727dee3c08150e0e6cb0050298055e6b7e97355344bc065ab0753febd85e4e0d Sep 10 02:34:52.244228 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.244161 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2"] Sep 10 02:34:52.247626 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:52.247597 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfce1a77_e7d9_465e_a581_c9f0538b4335.slice/crio-1d40d2b7e339eb3a6d80c8836a59015ba2a825b4c6f665079a83f9cb63973668 WatchSource:0}: Error finding container 1d40d2b7e339eb3a6d80c8836a59015ba2a825b4c6f665079a83f9cb63973668: Status 404 returned error can't find the container with id 1d40d2b7e339eb3a6d80c8836a59015ba2a825b4c6f665079a83f9cb63973668 Sep 10 02:34:52.631894 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.631801 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" event={"ID":"cfce1a77-e7d9-465e-a581-c9f0538b4335","Type":"ContainerStarted","Data":"1d40d2b7e339eb3a6d80c8836a59015ba2a825b4c6f665079a83f9cb63973668"} Sep 10 02:34:52.633326 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.633293 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8k7fw" event={"ID":"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2","Type":"ContainerStarted","Data":"727dee3c08150e0e6cb0050298055e6b7e97355344bc065ab0753febd85e4e0d"} Sep 10 02:34:52.672273 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.672243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:52.674993 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.674963 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-5dcpn\" (UID: \"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:52.813944 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.813910 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" Sep 10 02:34:52.964153 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.964065 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5cfccb5847-7vfkd"] Sep 10 02:34:52.979396 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.979366 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cfccb5847-7vfkd"] Sep 10 02:34:52.979544 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.979517 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:52.982361 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.982326 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 10 02:34:52.983032 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.982588 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 10 02:34:52.983032 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.982691 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-21u5ht2tehcne\"" Sep 10 02:34:52.983032 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.982782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 10 02:34:52.983032 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.982957 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 10 02:34:52.983032 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.982993 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 10 02:34:52.983293 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:52.983155 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-spbfk\"" Sep 10 02:34:53.078099 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.078065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-tls\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.078244 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.078138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.078244 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.078209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.078363 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.078253 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-grpc-tls\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.078363 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.078306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96gff\" (UniqueName: \"kubernetes.io/projected/4d6368fd-0d84-456e-b52f-40d48156272c-kube-api-access-96gff\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.078363 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.078337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.078513 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.078368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.078513 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.078390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d6368fd-0d84-456e-b52f-40d48156272c-metrics-client-ca\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.179521 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.179491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.179702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.179542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-grpc-tls\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.179702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.179563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96gff\" (UniqueName: \"kubernetes.io/projected/4d6368fd-0d84-456e-b52f-40d48156272c-kube-api-access-96gff\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.179702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.179591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.179702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.179619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.179702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.179635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d6368fd-0d84-456e-b52f-40d48156272c-metrics-client-ca\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.179702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.179672 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-tls\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.180032 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.179718 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.180911 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.180884 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d6368fd-0d84-456e-b52f-40d48156272c-metrics-client-ca\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.183440 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.183405 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.183596 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.183568 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-grpc-tls\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.183723 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.183630 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-tls\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.184569 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.184541 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.185543 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.185516 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.186000 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.185946 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d6368fd-0d84-456e-b52f-40d48156272c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.189723 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.189683 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96gff\" (UniqueName: \"kubernetes.io/projected/4d6368fd-0d84-456e-b52f-40d48156272c-kube-api-access-96gff\") pod \"thanos-querier-5cfccb5847-7vfkd\" (UID: \"4d6368fd-0d84-456e-b52f-40d48156272c\") " pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.293679 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.293434 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:53.502182 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.502122 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn"] Sep 10 02:34:53.595702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.595674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cfccb5847-7vfkd"] Sep 10 02:34:53.647718 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:53.647682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8k7fw" event={"ID":"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2","Type":"ContainerStarted","Data":"83361d75eaa75fbd8938fc36d49d632d9d013f10410332ccb3bf58844a3e793e"} Sep 10 02:34:53.782052 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:53.781985 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6368fd_0d84_456e_b52f_40d48156272c.slice/crio-4807cd4ed6a6c6315a199b19fc4a0f4ef664f09eeae387c5de794ad63e21f1ef WatchSource:0}: Error finding container 4807cd4ed6a6c6315a199b19fc4a0f4ef664f09eeae387c5de794ad63e21f1ef: Status 404 returned error can't find the container with id 4807cd4ed6a6c6315a199b19fc4a0f4ef664f09eeae387c5de794ad63e21f1ef Sep 10 02:34:53.783028 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:34:53.782992 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766fac2b_a5dd_4fb4_a9ca_654dcdd9bb41.slice/crio-a34b9532b22c3e0d1cbbc32eab4499ced1701ab2b4d2754a4fe8d921f109ab03 WatchSource:0}: Error finding container a34b9532b22c3e0d1cbbc32eab4499ced1701ab2b4d2754a4fe8d921f109ab03: Status 404 returned error can't find the container with id a34b9532b22c3e0d1cbbc32eab4499ced1701ab2b4d2754a4fe8d921f109ab03 Sep 10 02:34:54.528101 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.528020 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcwss" Sep 10 02:34:54.656775 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.656733 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" event={"ID":"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41","Type":"ContainerStarted","Data":"83dfb80ae28a5768ea3350a6ac70c5bf9762bcdda0fc4877877210b3f1b3507e"} Sep 10 02:34:54.656960 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.656805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" event={"ID":"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41","Type":"ContainerStarted","Data":"438c783b437e44c1de052b8fa7a7d04e3790457bcfd95d866a191f4821a6fcfc"} Sep 10 02:34:54.656960 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.656834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" event={"ID":"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41","Type":"ContainerStarted","Data":"a34b9532b22c3e0d1cbbc32eab4499ced1701ab2b4d2754a4fe8d921f109ab03"} Sep 10 02:34:54.660199 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.659818 2559 generic.go:356] "Generic (PLEG): container finished" podID="c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2" containerID="83361d75eaa75fbd8938fc36d49d632d9d013f10410332ccb3bf58844a3e793e" exitCode=0 Sep 10 02:34:54.660199 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.659947 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8k7fw" event={"ID":"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2","Type":"ContainerDied","Data":"83361d75eaa75fbd8938fc36d49d632d9d013f10410332ccb3bf58844a3e793e"} Sep 10 02:34:54.665413 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.665274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" event={"ID":"cfce1a77-e7d9-465e-a581-c9f0538b4335","Type":"ContainerStarted","Data":"4f05bb34c4aa0c18c23a4d40843bacfe27585dcd72d8dab242c6d35088a22f5f"} Sep 10 02:34:54.665413 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.665331 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" event={"ID":"cfce1a77-e7d9-465e-a581-c9f0538b4335","Type":"ContainerStarted","Data":"c123a70afe4eae1426a699c698651d9da1fd0ac4e13561ebd7ea07fa5c4a41da"} Sep 10 02:34:54.665413 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.665358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" event={"ID":"cfce1a77-e7d9-465e-a581-c9f0538b4335","Type":"ContainerStarted","Data":"c05dc9f03678d7331c11c4c1f6fc2fbd7a28fe1f443b6f05d18a623880b0bcf6"} Sep 10 02:34:54.668133 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:54.668050 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" event={"ID":"4d6368fd-0d84-456e-b52f-40d48156272c","Type":"ContainerStarted","Data":"4807cd4ed6a6c6315a199b19fc4a0f4ef664f09eeae387c5de794ad63e21f1ef"} Sep 10 02:34:55.675034 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:55.674997 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" event={"ID":"766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41","Type":"ContainerStarted","Data":"67c603c5e0fb628869a83b2820f12780b38ecffb5b67e2aa565d458c46b4a745"} Sep 10 02:34:55.679013 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:55.678907 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8k7fw" event={"ID":"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2","Type":"ContainerStarted","Data":"5f4f561bde92d9bae16b3538610555ea431518afc1afc49bef68b63995a68c50"} Sep 10 02:34:55.679013 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:55.678971 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8k7fw" event={"ID":"c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2","Type":"ContainerStarted","Data":"9fb578a37cdbfafa4e5e3715fd2229814afd733a35c60069ab20bc5bebdefa7c"} Sep 10 02:34:55.700320 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:55.700264 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-w9fr2" podStartSLOduration=4.140679123 podStartE2EDuration="5.700242939s" totalImagesPullingTime="1.559563816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:54.704727267 +0000 UTC m=+60.919712790" watchObservedRunningTime="2026-09-10 02:34:55.700242939 +0000 UTC m=+61.915228463" Sep 10 02:34:55.723584 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:55.723155 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-5dcpn" podStartSLOduration=4.58841117 podStartE2EDuration="5.723135307s" totalImagesPullingTime="1.134724137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:55.699794374 +0000 UTC m=+61.914779896" watchObservedRunningTime="2026-09-10 02:34:55.723135307 +0000 UTC m=+61.938120831" Sep 10 02:34:55.723584 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:55.723291 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8k7fw" podStartSLOduration=4.350943255 podStartE2EDuration="5.723284216s" totalImagesPullingTime="1.268523138s" totalInitContainerRuntime="103.817823ms" isStatefulPod=true podCreationTimestamp="2026-09-10 02:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:55.722317828 +0000 UTC m=+61.937303370" watchObservedRunningTime="2026-09-10 02:34:55.723284216 +0000 UTC m=+61.938269739" Sep 10 02:34:56.686475 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:56.686433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" event={"ID":"4d6368fd-0d84-456e-b52f-40d48156272c","Type":"ContainerStarted","Data":"35b8cc6f1f1b58b5f17b0c22e33b547ced773ab5dab827b21ad6caed4a7bdcba"} Sep 10 02:34:56.686968 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:56.686529 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" event={"ID":"4d6368fd-0d84-456e-b52f-40d48156272c","Type":"ContainerStarted","Data":"7f9943271c2a600f0f93fc3b1d633c0ec2b8ee856cd576340bdb7eeaf9f56516"} Sep 10 02:34:56.686968 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:56.686582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" event={"ID":"4d6368fd-0d84-456e-b52f-40d48156272c","Type":"ContainerStarted","Data":"649cd9f68b1957a05060fb347a3f1b62c8b12b107cb273f15d9b9657ddafb6b1"} Sep 10 02:34:57.190725 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.188760 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:34:57.193130 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.193110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.198522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.196520 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 02:34:57.198522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.196764 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-befnvcblll1lc\"" Sep 10 02:34:57.198522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.196519 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 02:34:57.198522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.197001 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.199037 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.199254 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.199455 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.199696 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.200293 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.200600 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.200805 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7ghs6\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.200832 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 02:34:57.201525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.201298 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 02:34:57.202011 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.201532 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 02:34:57.202011 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.201656 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 02:34:57.204978 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.203017 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 02:34:57.207182 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.207161 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 02:34:57.208866 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.208788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:34:57.324489 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324456 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324639 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324639 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324639 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324639 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324639 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324639 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324639 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324632 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-web-config\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwtvp\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-kube-api-access-rwtvp\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config-out\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.324874 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.324841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.425796 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.425761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.425988 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.425813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.425988 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.425857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.425988 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.425884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.425988 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.425919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.425988 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.425977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.425995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-web-config\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwtvp\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-kube-api-access-rwtvp\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426232 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config-out\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426267 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426797 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426797 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.426797 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.426585 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.428637 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.428052 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.428637 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.428351 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.430646 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.429691 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.430646 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.430014 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-web-config\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.430646 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.430104 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.430646 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.430335 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.433704 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.431219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.433704 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.431562 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.433704 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.432530 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.433704 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.433061 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.433704 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.433400 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.433704 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.433536 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.433704 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.433656 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.434242 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.434168 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.434242 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.434219 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.435510 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.435480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.435838 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.435815 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.436131 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.436111 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config-out\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.437039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.437008 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwtvp\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-kube-api-access-rwtvp\") pod \"prometheus-k8s-0\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.531892 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.531814 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:34:57.694714 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.694675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" event={"ID":"4d6368fd-0d84-456e-b52f-40d48156272c","Type":"ContainerStarted","Data":"c24c788b0095e994d6626016a8239cba4731c00b69a6fd90b8328d33592cd756"} Sep 10 02:34:57.695196 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.694753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" event={"ID":"4d6368fd-0d84-456e-b52f-40d48156272c","Type":"ContainerStarted","Data":"17ba3d3e43c173948c2474b1262d252464c893137184e1830ae922c7f777b299"} Sep 10 02:34:57.695196 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.694798 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" event={"ID":"4d6368fd-0d84-456e-b52f-40d48156272c","Type":"ContainerStarted","Data":"7b08357e87942b08939ed9cf11e02ec45e12801340c398aa4e158f332d96954a"} Sep 10 02:34:57.695196 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.695008 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:34:57.717364 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:57.717313 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" podStartSLOduration=2.690412668 podStartE2EDuration="5.71729678s" totalImagesPullingTime="3.026884112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:34:57.715800063 +0000 UTC m=+63.930785584" watchObservedRunningTime="2026-09-10 02:34:57.71729678 +0000 UTC m=+63.932282305" Sep 10 02:34:59.950943 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:59.950897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:34:59.953671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:59.953634 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 02:34:59.964557 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:34:59.964527 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b1b6871-29ad-4c86-8d5e-ad9470704f9e-original-pull-secret\") pod \"global-pull-secret-syncer-tglws\" (UID: \"7b1b6871-29ad-4c86-8d5e-ad9470704f9e\") " pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:35:00.051984 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.051942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:35:00.056284 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.056259 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 02:35:00.064947 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.064903 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/054304ea-1c6d-48fc-aaa8-8339373832c9-metrics-certs\") pod \"network-metrics-daemon-fsnp7\" (UID: \"054304ea-1c6d-48fc-aaa8-8339373832c9\") " pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:35:00.153023 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.152992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:35:00.156150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.156125 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 02:35:00.165991 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.165969 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 02:35:00.176712 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.176690 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcp5s\" (UniqueName: \"kubernetes.io/projected/8a5ecaf0-889a-429b-97d3-2535af6d1be3-kube-api-access-fcp5s\") pod \"network-check-target-62kk4\" (UID: \"8a5ecaf0-889a-429b-97d3-2535af6d1be3\") " pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:35:00.186211 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.186192 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwtct\"" Sep 10 02:35:00.190303 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.190285 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tglws" Sep 10 02:35:00.194410 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.194393 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsnp7" Sep 10 02:35:00.478151 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.478109 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tcpg8\"" Sep 10 02:35:00.486242 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:00.486213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:35:03.706216 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:03.706187 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5cfccb5847-7vfkd" Sep 10 02:35:05.036235 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.036214 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tglws"] Sep 10 02:35:05.040046 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.039918 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fsnp7"] Sep 10 02:35:05.041259 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.041239 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-62kk4"] Sep 10 02:35:05.050650 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.050631 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:35:05.109941 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:35:05.109887 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1b6871_29ad_4c86_8d5e_ad9470704f9e.slice/crio-c77da3ff0d913c384b5461b803ac9e35d3731501a95a5a824a292059e8a155ba WatchSource:0}: Error finding container c77da3ff0d913c384b5461b803ac9e35d3731501a95a5a824a292059e8a155ba: Status 404 returned error can't find the container with id c77da3ff0d913c384b5461b803ac9e35d3731501a95a5a824a292059e8a155ba Sep 10 02:35:05.110517 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:35:05.110446 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5ecaf0_889a_429b_97d3_2535af6d1be3.slice/crio-dd9b053e06c9dc958641b1b7437928eff961c373ec79f39f295541cade97dfa9 WatchSource:0}: Error finding container dd9b053e06c9dc958641b1b7437928eff961c373ec79f39f295541cade97dfa9: Status 404 returned error can't find the container with id dd9b053e06c9dc958641b1b7437928eff961c373ec79f39f295541cade97dfa9 Sep 10 02:35:05.111356 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:35:05.111243 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054304ea_1c6d_48fc_aaa8_8339373832c9.slice/crio-c05a2bc509d1695ca49dcb3c2dd376232d831e2495d6077f71af41da92b44f3f WatchSource:0}: Error finding container c05a2bc509d1695ca49dcb3c2dd376232d831e2495d6077f71af41da92b44f3f: Status 404 returned error can't find the container with id c05a2bc509d1695ca49dcb3c2dd376232d831e2495d6077f71af41da92b44f3f Sep 10 02:35:05.112334 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:35:05.112318 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8556282b_37b6_4dfc_96c8_f3bd13343fa3.slice/crio-d6b31b8d64a24af1a9131b61f23baa4524d23cdf77b94714aa2561b69c9c1673 WatchSource:0}: Error finding container d6b31b8d64a24af1a9131b61f23baa4524d23cdf77b94714aa2561b69c9c1673: Status 404 returned error can't find the container with id d6b31b8d64a24af1a9131b61f23baa4524d23cdf77b94714aa2561b69c9c1673 Sep 10 02:35:05.735772 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.735207 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-62kk4" event={"ID":"8a5ecaf0-889a-429b-97d3-2535af6d1be3","Type":"ContainerStarted","Data":"dd9b053e06c9dc958641b1b7437928eff961c373ec79f39f295541cade97dfa9"} Sep 10 02:35:05.740509 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.740474 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsnp7" event={"ID":"054304ea-1c6d-48fc-aaa8-8339373832c9","Type":"ContainerStarted","Data":"c05a2bc509d1695ca49dcb3c2dd376232d831e2495d6077f71af41da92b44f3f"} Sep 10 02:35:05.743489 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.743416 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-7ppbf" event={"ID":"b0fe8b34-491b-48f7-8a08-297cda1a0d23","Type":"ContainerStarted","Data":"c861fc79dd9653d17f733b48f52cf71502951b72675430c4d3e1482e2e4e6f14"} Sep 10 02:35:05.744426 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.744407 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-7ppbf" Sep 10 02:35:05.750973 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.750951 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerStarted","Data":"d6b31b8d64a24af1a9131b61f23baa4524d23cdf77b94714aa2561b69c9c1673"} Sep 10 02:35:05.752650 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.752604 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tglws" event={"ID":"7b1b6871-29ad-4c86-8d5e-ad9470704f9e","Type":"ContainerStarted","Data":"c77da3ff0d913c384b5461b803ac9e35d3731501a95a5a824a292059e8a155ba"} Sep 10 02:35:05.758505 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.758463 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-7ppbf" Sep 10 02:35:05.768665 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:05.767951 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-7ppbf" podStartSLOduration=1.586715364 podStartE2EDuration="19.767912929s" totalImagesPullingTime="18.181197565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:35:05.765745468 +0000 UTC m=+71.980730993" watchObservedRunningTime="2026-09-10 02:35:05.767912929 +0000 UTC m=+71.982898453" Sep 10 02:35:08.771695 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:08.771321 2559 generic.go:356] "Generic (PLEG): container finished" podID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" exitCode=0 Sep 10 02:35:08.772293 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:08.772076 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerDied","Data":"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451"} Sep 10 02:35:08.777717 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:08.777154 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsnp7" event={"ID":"054304ea-1c6d-48fc-aaa8-8339373832c9","Type":"ContainerStarted","Data":"7f06ddfbbb9aa33455a63584b61bb12fd52d7f31096b0ea73673a6b2a77f8bda"} Sep 10 02:35:08.777717 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:08.777208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsnp7" event={"ID":"054304ea-1c6d-48fc-aaa8-8339373832c9","Type":"ContainerStarted","Data":"e1e3d574c12d78c42f91256b9168e28fc09803e69e15287aba5c649702e1f524"} Sep 10 02:35:08.853079 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:08.853011 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fsnp7" podStartSLOduration=72.109839685 podStartE2EDuration="1m14.852960249s" totalImagesPullingTime="2.743120564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:35:08.852019959 +0000 UTC m=+75.067005511" watchObservedRunningTime="2026-09-10 02:35:08.852960249 +0000 UTC m=+75.067945775" Sep 10 02:35:14.823523 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:14.823496 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerStarted","Data":"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4"} Sep 10 02:35:14.823844 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:14.823596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerStarted","Data":"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801"} Sep 10 02:35:14.823844 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:14.823625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerStarted","Data":"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1"} Sep 10 02:35:14.825368 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:14.825343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tglws" event={"ID":"7b1b6871-29ad-4c86-8d5e-ad9470704f9e","Type":"ContainerStarted","Data":"91c23aaf734777ebf57e14cb3673ac2bcbbd18fa7fb861fe3807179cfdb2af81"} Sep 10 02:35:14.826978 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:14.826956 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-62kk4" event={"ID":"8a5ecaf0-889a-429b-97d3-2535af6d1be3","Type":"ContainerStarted","Data":"18c3894a77ed3fc9ab7ac06fb95813c5e96b3d9d33eb8998790b5774ed284c3c"} Sep 10 02:35:14.827149 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:14.827134 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:35:14.843183 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:14.842471 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tglws" podStartSLOduration=71.993554485 podStartE2EDuration="1m20.842450366s" totalImagesPullingTime="8.848895881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:35:14.841015069 +0000 UTC m=+81.056000592" watchObservedRunningTime="2026-09-10 02:35:14.842450366 +0000 UTC m=+81.057435890" Sep 10 02:35:14.856633 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:14.856557 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-62kk4" podStartSLOduration=72.007697759 podStartE2EDuration="1m20.856536745s" totalImagesPullingTime="8.848838986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:35:14.85523685 +0000 UTC m=+81.070222376" watchObservedRunningTime="2026-09-10 02:35:14.856536745 +0000 UTC m=+81.071522270" Sep 10 02:35:15.835829 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:15.835693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerStarted","Data":"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e"} Sep 10 02:35:15.835829 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:15.835779 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerStarted","Data":"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e"} Sep 10 02:35:15.835829 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:15.835819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerStarted","Data":"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99"} Sep 10 02:35:15.866157 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:15.866108 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=10.511217843 podStartE2EDuration="18.866086589s" totalImagesPullingTime="8.327762034s" totalInitContainerRuntime="27.106712ms" isStatefulPod=false podCreationTimestamp="2026-09-10 02:34:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:35:15.863618752 +0000 UTC m=+82.078604275" watchObservedRunningTime="2026-09-10 02:35:15.866086589 +0000 UTC m=+82.081072116" Sep 10 02:35:17.531979 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:17.531918 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:35:21.281501 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:21.281460 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-w9fr2_cfce1a77-e7d9-465e-a581-c9f0538b4335/kube-state-metrics/0.log" Sep 10 02:35:21.480761 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:21.480733 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-w9fr2_cfce1a77-e7d9-465e-a581-c9f0538b4335/kube-rbac-proxy-main/0.log" Sep 10 02:35:21.680645 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:21.680624 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-w9fr2_cfce1a77-e7d9-465e-a581-c9f0538b4335/kube-rbac-proxy-self/0.log" Sep 10 02:35:22.280054 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:22.280029 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8k7fw_c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2/init-textfile/0.log" Sep 10 02:35:22.481773 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:22.481749 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8k7fw_c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2/node-exporter/0.log" Sep 10 02:35:22.685041 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:22.685020 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8k7fw_c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2/kube-rbac-proxy/0.log" Sep 10 02:35:24.081184 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:24.081155 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-5dcpn_766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41/kube-rbac-proxy-main/0.log" Sep 10 02:35:24.279891 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:24.279862 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-5dcpn_766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41/kube-rbac-proxy-self/0.log" Sep 10 02:35:24.480878 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:24.480855 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-5dcpn_766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41/openshift-state-metrics/0.log" Sep 10 02:35:24.692279 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:24.692243 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8556282b-37b6-4dfc-96c8-f3bd13343fa3/init-config-reloader/0.log" Sep 10 02:35:24.881696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:24.881675 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8556282b-37b6-4dfc-96c8-f3bd13343fa3/prometheus/0.log" Sep 10 02:35:25.080448 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:25.080426 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8556282b-37b6-4dfc-96c8-f3bd13343fa3/config-reloader/0.log" Sep 10 02:35:25.280448 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:25.280392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8556282b-37b6-4dfc-96c8-f3bd13343fa3/thanos-sidecar/0.log" Sep 10 02:35:25.480356 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:25.480337 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8556282b-37b6-4dfc-96c8-f3bd13343fa3/kube-rbac-proxy-web/0.log" Sep 10 02:35:25.681341 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:25.681291 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8556282b-37b6-4dfc-96c8-f3bd13343fa3/kube-rbac-proxy/0.log" Sep 10 02:35:25.881679 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:25.881657 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8556282b-37b6-4dfc-96c8-f3bd13343fa3/kube-rbac-proxy-thanos/0.log" Sep 10 02:35:26.081470 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:26.081389 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-rqt4r_848eff4a-2d61-406b-8811-9809f6a4f6e6/prometheus-operator/0.log" Sep 10 02:35:26.279714 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:26.279688 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-rqt4r_848eff4a-2d61-406b-8811-9809f6a4f6e6/kube-rbac-proxy/0.log" Sep 10 02:35:26.480201 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:26.480180 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-lg95n_523369b4-d018-4d3a-b0eb-c52d6a95f33e/prometheus-operator-admission-webhook/0.log" Sep 10 02:35:27.281526 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:27.281492 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/thanos-query/0.log" Sep 10 02:35:27.480888 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:27.480864 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/kube-rbac-proxy-web/0.log" Sep 10 02:35:27.680386 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:27.680364 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/kube-rbac-proxy/0.log" Sep 10 02:35:27.881386 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:27.881365 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/prom-label-proxy/0.log" Sep 10 02:35:28.080763 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:28.080699 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/kube-rbac-proxy-rules/0.log" Sep 10 02:35:28.280481 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:28.280457 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/kube-rbac-proxy-metrics/0.log" Sep 10 02:35:29.482142 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:29.482097 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-7ppbf_b0fe8b34-491b-48f7-8a08-297cda1a0d23/download-server/0.log" Sep 10 02:35:45.838796 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:45.838758 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-62kk4" Sep 10 02:35:57.532541 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:57.532500 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:35:57.588577 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:57.588550 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:35:58.023434 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:35:58.023407 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:15.515150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.515100 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:36:15.515658 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.515573 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="thanos-sidecar" containerID="cri-o://733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" gracePeriod=600 Sep 10 02:36:15.515658 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.515574 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy" containerID="cri-o://c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" gracePeriod=600 Sep 10 02:36:15.515658 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.515631 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="config-reloader" containerID="cri-o://6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" gracePeriod=600 Sep 10 02:36:15.515827 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.515646 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy-web" containerID="cri-o://2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" gracePeriod=600 Sep 10 02:36:15.515827 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.515633 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" gracePeriod=600 Sep 10 02:36:15.515919 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.515558 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="prometheus" containerID="cri-o://fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" gracePeriod=600 Sep 10 02:36:15.771297 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.771164 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.849837 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-metrics-client-ca\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.849878 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-trusted-ca-bundle\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.849910 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-thanos-prometheus-http-client-file\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.849958 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwtvp\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-kube-api-access-rwtvp\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.849982 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-kube-rbac-proxy\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850011 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-2\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850037 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-tls\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850067 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-serving-certs-ca-bundle\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850093 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-grpc-tls\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850119 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-0\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850152 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850181 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-1\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850204 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-db\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850240 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-web-config\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850288 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-metrics-client-certs\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850317 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850344 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config-out\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.851412 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850367 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-kubelet-serving-ca-bundle\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.852688 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850396 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.852688 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.850419 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-tls-assets\") pod \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\" (UID: \"8556282b-37b6-4dfc-96c8-f3bd13343fa3\") " Sep 10 02:36:15.852688 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.852061 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:15.852688 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.852123 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:15.852688 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.852338 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:15.852688 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.852516 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:15.852688 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.852597 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:15.853064 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.852914 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:36:15.853943 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.853892 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:15.854101 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.854077 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 02:36:15.854878 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.854832 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:36:15.856792 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.856743 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.857007 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.856888 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.857248 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.857211 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.857337 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.857305 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.857775 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.857516 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.857775 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.857648 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config" (OuterVolumeSpecName: "config") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.857775 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.857716 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.857775 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.857752 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config-out" (OuterVolumeSpecName: "config-out") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 02:36:15.858716 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.858687 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.858890 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.858864 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-kube-api-access-rwtvp" (OuterVolumeSpecName: "kube-api-access-rwtvp") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "kube-api-access-rwtvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:36:15.873836 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.873794 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-web-config" (OuterVolumeSpecName: "web-config") pod "8556282b-37b6-4dfc-96c8-f3bd13343fa3" (UID: "8556282b-37b6-4dfc-96c8-f3bd13343fa3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:36:15.951866 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951823 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.951866 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951859 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-db\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951887 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-web-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951896 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-metrics-client-certs\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951907 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951917 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config-out\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951947 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951956 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951964 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-tls-assets\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951974 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-metrics-client-ca\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951982 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.951991 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.952000 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwtvp\" (UniqueName: \"kubernetes.io/projected/8556282b-37b6-4dfc-96c8-f3bd13343fa3-kube-api-access-rwtvp\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.952008 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-kube-rbac-proxy\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.952017 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.952025 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.952033 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.952041 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-secret-grpc-tls\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.952051 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8556282b-37b6-4dfc-96c8-f3bd13343fa3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:15.952110 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:15.952058 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8556282b-37b6-4dfc-96c8-f3bd13343fa3-config\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:36:16.081342 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081260 2559 generic.go:356] "Generic (PLEG): container finished" podID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" exitCode=0 Sep 10 02:36:16.081342 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081283 2559 generic.go:356] "Generic (PLEG): container finished" podID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" exitCode=0 Sep 10 02:36:16.081342 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081289 2559 generic.go:356] "Generic (PLEG): container finished" podID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" exitCode=0 Sep 10 02:36:16.081342 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081294 2559 generic.go:356] "Generic (PLEG): container finished" podID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" exitCode=0 Sep 10 02:36:16.081342 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081299 2559 generic.go:356] "Generic (PLEG): container finished" podID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" exitCode=0 Sep 10 02:36:16.081342 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081304 2559 generic.go:356] "Generic (PLEG): container finished" podID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" exitCode=0 Sep 10 02:36:16.081342 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081330 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerDied","Data":"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e"} Sep 10 02:36:16.081696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081398 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerDied","Data":"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e"} Sep 10 02:36:16.081696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081341 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.081696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081427 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerDied","Data":"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99"} Sep 10 02:36:16.081696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081451 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerDied","Data":"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4"} Sep 10 02:36:16.081696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081475 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerDied","Data":"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801"} Sep 10 02:36:16.081696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081490 2559 scope.go:117] "RemoveContainer" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" Sep 10 02:36:16.081696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081499 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerDied","Data":"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1"} Sep 10 02:36:16.081696 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.081522 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8556282b-37b6-4dfc-96c8-f3bd13343fa3","Type":"ContainerDied","Data":"d6b31b8d64a24af1a9131b61f23baa4524d23cdf77b94714aa2561b69c9c1673"} Sep 10 02:36:16.090568 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.090550 2559 scope.go:117] "RemoveContainer" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" Sep 10 02:36:16.098894 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.098867 2559 scope.go:117] "RemoveContainer" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" Sep 10 02:36:16.106170 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.106130 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:36:16.109273 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.109140 2559 scope.go:117] "RemoveContainer" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" Sep 10 02:36:16.111503 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.111477 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:36:16.117908 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.117884 2559 scope.go:117] "RemoveContainer" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" Sep 10 02:36:16.126113 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.126084 2559 scope.go:117] "RemoveContainer" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" Sep 10 02:36:16.133809 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.133791 2559 scope.go:117] "RemoveContainer" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" Sep 10 02:36:16.141101 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.141073 2559 scope.go:117] "RemoveContainer" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.142555 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143156 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="config-reloader" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143180 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="config-reloader" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143200 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="thanos-sidecar" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143217 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="thanos-sidecar" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143228 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143237 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143265 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="prometheus" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143274 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="prometheus" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143284 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy-thanos" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143292 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy-thanos" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143311 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="init-config-reloader" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143319 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="init-config-reloader" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143341 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy-web" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143351 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy-web" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143504 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy-web" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143514 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143523 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="prometheus" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143539 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="config-reloader" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143547 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="kube-rbac-proxy-thanos" Sep 10 02:36:16.145643 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.143557 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" containerName="thanos-sidecar" Sep 10 02:36:16.146539 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:36:16.146185 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": container with ID starting with 9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e not found: ID does not exist" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" Sep 10 02:36:16.146539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.146220 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e"} err="failed to get container status \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": rpc error: code = NotFound desc = could not find container \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": container with ID starting with 9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e not found: ID does not exist" Sep 10 02:36:16.146539 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.146260 2559 scope.go:117] "RemoveContainer" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" Sep 10 02:36:16.146539 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:36:16.146519 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": container with ID starting with c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e not found: ID does not exist" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" Sep 10 02:36:16.146703 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.146544 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e"} err="failed to get container status \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": rpc error: code = NotFound desc = could not find container \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": container with ID starting with c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e not found: ID does not exist" Sep 10 02:36:16.146703 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.146563 2559 scope.go:117] "RemoveContainer" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" Sep 10 02:36:16.146846 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:36:16.146820 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": container with ID starting with 2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99 not found: ID does not exist" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" Sep 10 02:36:16.147004 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.146849 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99"} err="failed to get container status \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": rpc error: code = NotFound desc = could not find container \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": container with ID starting with 2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99 not found: ID does not exist" Sep 10 02:36:16.147004 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.146863 2559 scope.go:117] "RemoveContainer" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" Sep 10 02:36:16.147191 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:36:16.147173 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": container with ID starting with 733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4 not found: ID does not exist" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" Sep 10 02:36:16.147256 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.147196 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4"} err="failed to get container status \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": rpc error: code = NotFound desc = could not find container \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": container with ID starting with 733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4 not found: ID does not exist" Sep 10 02:36:16.147256 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.147238 2559 scope.go:117] "RemoveContainer" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" Sep 10 02:36:16.147726 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:36:16.147697 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": container with ID starting with 6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801 not found: ID does not exist" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" Sep 10 02:36:16.147818 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.147741 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801"} err="failed to get container status \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": rpc error: code = NotFound desc = could not find container \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": container with ID starting with 6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801 not found: ID does not exist" Sep 10 02:36:16.147818 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.147765 2559 scope.go:117] "RemoveContainer" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" Sep 10 02:36:16.148147 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:36:16.148126 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": container with ID starting with fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1 not found: ID does not exist" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" Sep 10 02:36:16.148243 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.148156 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1"} err="failed to get container status \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": rpc error: code = NotFound desc = could not find container \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": container with ID starting with fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1 not found: ID does not exist" Sep 10 02:36:16.148243 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.148203 2559 scope.go:117] "RemoveContainer" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" Sep 10 02:36:16.148585 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:36:16.148541 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": container with ID starting with 97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451 not found: ID does not exist" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" Sep 10 02:36:16.148679 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.148582 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451"} err="failed to get container status \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": rpc error: code = NotFound desc = could not find container \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": container with ID starting with 97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451 not found: ID does not exist" Sep 10 02:36:16.148679 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.148600 2559 scope.go:117] "RemoveContainer" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" Sep 10 02:36:16.148855 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.148835 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e"} err="failed to get container status \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": rpc error: code = NotFound desc = could not find container \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": container with ID starting with 9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e not found: ID does not exist" Sep 10 02:36:16.148898 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.148856 2559 scope.go:117] "RemoveContainer" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" Sep 10 02:36:16.149143 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.149125 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e"} err="failed to get container status \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": rpc error: code = NotFound desc = could not find container \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": container with ID starting with c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e not found: ID does not exist" Sep 10 02:36:16.149222 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.149146 2559 scope.go:117] "RemoveContainer" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" Sep 10 02:36:16.149262 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.149225 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.149676 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.149424 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99"} err="failed to get container status \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": rpc error: code = NotFound desc = could not find container \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": container with ID starting with 2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99 not found: ID does not exist" Sep 10 02:36:16.149676 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.149447 2559 scope.go:117] "RemoveContainer" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" Sep 10 02:36:16.149992 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.149953 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4"} err="failed to get container status \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": rpc error: code = NotFound desc = could not find container \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": container with ID starting with 733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4 not found: ID does not exist" Sep 10 02:36:16.150065 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.149997 2559 scope.go:117] "RemoveContainer" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" Sep 10 02:36:16.150330 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.150302 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801"} err="failed to get container status \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": rpc error: code = NotFound desc = could not find container \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": container with ID starting with 6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801 not found: ID does not exist" Sep 10 02:36:16.150418 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.150331 2559 scope.go:117] "RemoveContainer" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" Sep 10 02:36:16.150585 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.150566 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1"} err="failed to get container status \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": rpc error: code = NotFound desc = could not find container \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": container with ID starting with fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1 not found: ID does not exist" Sep 10 02:36:16.150667 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.150586 2559 scope.go:117] "RemoveContainer" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" Sep 10 02:36:16.150876 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.150853 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451"} err="failed to get container status \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": rpc error: code = NotFound desc = could not find container \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": container with ID starting with 97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451 not found: ID does not exist" Sep 10 02:36:16.150981 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.150881 2559 scope.go:117] "RemoveContainer" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" Sep 10 02:36:16.151198 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.151179 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e"} err="failed to get container status \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": rpc error: code = NotFound desc = could not find container \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": container with ID starting with 9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e not found: ID does not exist" Sep 10 02:36:16.151268 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.151199 2559 scope.go:117] "RemoveContainer" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" Sep 10 02:36:16.151526 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.151485 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e"} err="failed to get container status \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": rpc error: code = NotFound desc = could not find container \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": container with ID starting with c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e not found: ID does not exist" Sep 10 02:36:16.151639 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.151527 2559 scope.go:117] "RemoveContainer" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" Sep 10 02:36:16.151845 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.151817 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99"} err="failed to get container status \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": rpc error: code = NotFound desc = could not find container \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": container with ID starting with 2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99 not found: ID does not exist" Sep 10 02:36:16.151952 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.151847 2559 scope.go:117] "RemoveContainer" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" Sep 10 02:36:16.152246 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.152121 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4"} err="failed to get container status \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": rpc error: code = NotFound desc = could not find container \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": container with ID starting with 733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4 not found: ID does not exist" Sep 10 02:36:16.152246 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.152146 2559 scope.go:117] "RemoveContainer" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" Sep 10 02:36:16.152426 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.152405 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 10 02:36:16.152608 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.152429 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 10 02:36:16.152716 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.152700 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.152838 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.152910 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-befnvcblll1lc\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153038 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801"} err="failed to get container status \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": rpc error: code = NotFound desc = could not find container \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": container with ID starting with 6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801 not found: ID does not exist" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153059 2559 scope.go:117] "RemoveContainer" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153174 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153221 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153357 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1"} err="failed to get container status \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": rpc error: code = NotFound desc = could not find container \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": container with ID starting with fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1 not found: ID does not exist" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153385 2559 scope.go:117] "RemoveContainer" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153400 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153497 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7ghs6\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153505 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153624 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153692 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153174 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153769 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451"} err="failed to get container status \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": rpc error: code = NotFound desc = could not find container \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": container with ID starting with 97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451 not found: ID does not exist" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153790 2559 scope.go:117] "RemoveContainer" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153404 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 10 02:36:16.154012 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.153911 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 10 02:36:16.154864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.154287 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e"} err="failed to get container status \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": rpc error: code = NotFound desc = could not find container \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": container with ID starting with 9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e not found: ID does not exist" Sep 10 02:36:16.154864 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.154310 2559 scope.go:117] "RemoveContainer" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" Sep 10 02:36:16.155856 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.155814 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e"} err="failed to get container status \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": rpc error: code = NotFound desc = could not find container \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": container with ID starting with c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e not found: ID does not exist" Sep 10 02:36:16.155856 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.155840 2559 scope.go:117] "RemoveContainer" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" Sep 10 02:36:16.156279 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.156253 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99"} err="failed to get container status \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": rpc error: code = NotFound desc = could not find container \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": container with ID starting with 2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99 not found: ID does not exist" Sep 10 02:36:16.156402 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.156280 2559 scope.go:117] "RemoveContainer" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" Sep 10 02:36:16.156602 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.156577 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4"} err="failed to get container status \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": rpc error: code = NotFound desc = could not find container \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": container with ID starting with 733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4 not found: ID does not exist" Sep 10 02:36:16.156687 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.156603 2559 scope.go:117] "RemoveContainer" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" Sep 10 02:36:16.156942 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.156905 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801"} err="failed to get container status \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": rpc error: code = NotFound desc = could not find container \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": container with ID starting with 6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801 not found: ID does not exist" Sep 10 02:36:16.157022 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.156955 2559 scope.go:117] "RemoveContainer" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" Sep 10 02:36:16.157333 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.157310 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1"} err="failed to get container status \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": rpc error: code = NotFound desc = could not find container \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": container with ID starting with fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1 not found: ID does not exist" Sep 10 02:36:16.157449 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.157343 2559 scope.go:117] "RemoveContainer" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" Sep 10 02:36:16.157449 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.157394 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 10 02:36:16.157761 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.157655 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451"} err="failed to get container status \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": rpc error: code = NotFound desc = could not find container \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": container with ID starting with 97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451 not found: ID does not exist" Sep 10 02:36:16.157761 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.157677 2559 scope.go:117] "RemoveContainer" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" Sep 10 02:36:16.158207 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.158186 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e"} err="failed to get container status \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": rpc error: code = NotFound desc = could not find container \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": container with ID starting with 9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e not found: ID does not exist" Sep 10 02:36:16.158300 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.158208 2559 scope.go:117] "RemoveContainer" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" Sep 10 02:36:16.158495 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.158475 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e"} err="failed to get container status \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": rpc error: code = NotFound desc = could not find container \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": container with ID starting with c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e not found: ID does not exist" Sep 10 02:36:16.158569 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.158496 2559 scope.go:117] "RemoveContainer" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" Sep 10 02:36:16.158753 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.158735 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99"} err="failed to get container status \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": rpc error: code = NotFound desc = could not find container \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": container with ID starting with 2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99 not found: ID does not exist" Sep 10 02:36:16.158831 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.158759 2559 scope.go:117] "RemoveContainer" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" Sep 10 02:36:16.159074 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159047 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4"} err="failed to get container status \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": rpc error: code = NotFound desc = could not find container \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": container with ID starting with 733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4 not found: ID does not exist" Sep 10 02:36:16.159165 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159075 2559 scope.go:117] "RemoveContainer" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" Sep 10 02:36:16.159387 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159364 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801"} err="failed to get container status \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": rpc error: code = NotFound desc = could not find container \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": container with ID starting with 6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801 not found: ID does not exist" Sep 10 02:36:16.159438 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159390 2559 scope.go:117] "RemoveContainer" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" Sep 10 02:36:16.159689 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159672 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1"} err="failed to get container status \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": rpc error: code = NotFound desc = could not find container \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": container with ID starting with fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1 not found: ID does not exist" Sep 10 02:36:16.159738 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159689 2559 scope.go:117] "RemoveContainer" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" Sep 10 02:36:16.159918 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159897 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 10 02:36:16.160022 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159968 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451"} err="failed to get container status \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": rpc error: code = NotFound desc = could not find container \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": container with ID starting with 97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451 not found: ID does not exist" Sep 10 02:36:16.160022 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.159985 2559 scope.go:117] "RemoveContainer" containerID="9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e" Sep 10 02:36:16.160297 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.160272 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e"} err="failed to get container status \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": rpc error: code = NotFound desc = could not find container \"9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e\": container with ID starting with 9bda99490eb03ba9e665730108e3d3d55e6746d315008601e5e1c0333e37359e not found: ID does not exist" Sep 10 02:36:16.160366 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.160301 2559 scope.go:117] "RemoveContainer" containerID="c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e" Sep 10 02:36:16.160593 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.160570 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e"} err="failed to get container status \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": rpc error: code = NotFound desc = could not find container \"c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e\": container with ID starting with c87cc9d84e43d16e1b3aa16139fb2cd1d809f8f7fdd86014320d2b21426d2b8e not found: ID does not exist" Sep 10 02:36:16.160661 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.160595 2559 scope.go:117] "RemoveContainer" containerID="2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99" Sep 10 02:36:16.160895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.160858 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99"} err="failed to get container status \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": rpc error: code = NotFound desc = could not find container \"2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99\": container with ID starting with 2368c59f56219522fe75a8e12e661b39f37446ad2409d140f2c070c0093e4d99 not found: ID does not exist" Sep 10 02:36:16.160895 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.160882 2559 scope.go:117] "RemoveContainer" containerID="733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4" Sep 10 02:36:16.163070 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.161943 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4"} err="failed to get container status \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": rpc error: code = NotFound desc = could not find container \"733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4\": container with ID starting with 733f8105240b0b87382bc16f35c8168df81640dda9f87b0e502884ecea7426b4 not found: ID does not exist" Sep 10 02:36:16.163070 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.161969 2559 scope.go:117] "RemoveContainer" containerID="6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801" Sep 10 02:36:16.163070 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.162217 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801"} err="failed to get container status \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": rpc error: code = NotFound desc = could not find container \"6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801\": container with ID starting with 6a20868ab3cd56ff203b11cf02c354b1d447b2a71412bb1ba8630e4c6b620801 not found: ID does not exist" Sep 10 02:36:16.163070 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.162236 2559 scope.go:117] "RemoveContainer" containerID="fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1" Sep 10 02:36:16.163070 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.162581 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1"} err="failed to get container status \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": rpc error: code = NotFound desc = could not find container \"fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1\": container with ID starting with fe1f0c0a9b65311bbd36c4e65b873d864ae8a170f946b82f2e6ba142c109bef1 not found: ID does not exist" Sep 10 02:36:16.163070 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.162606 2559 scope.go:117] "RemoveContainer" containerID="97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451" Sep 10 02:36:16.163070 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.162995 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:36:16.163322 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.163165 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451"} err="failed to get container status \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": rpc error: code = NotFound desc = could not find container \"97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451\": container with ID starting with 97d1e87d02bd9651cadd87ba94c3b5841305794dbff06a08887a3a2173b14451 not found: ID does not exist" Sep 10 02:36:16.255520 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255520 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255719 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255719 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255719 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255626 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255719 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7nnf\" (UniqueName: \"kubernetes.io/projected/73980114-ba3f-469b-a4e1-e201802346d1-kube-api-access-f7nnf\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255719 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255867 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73980114-ba3f-469b-a4e1-e201802346d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255867 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255749 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255867 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255867 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255867 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255821 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255867 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.255867 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.256104 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.256104 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.256104 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.255977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-config\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.256104 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.256001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.256104 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.256016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73980114-ba3f-469b-a4e1-e201802346d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.256104 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.256035 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.265455 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.265432 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8556282b-37b6-4dfc-96c8-f3bd13343fa3" path="/var/lib/kubelet/pods/8556282b-37b6-4dfc-96c8-f3bd13343fa3/volumes" Sep 10 02:36:16.357214 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.357214 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73980114-ba3f-469b-a4e1-e201802346d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.357214 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.357214 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.357545 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.357545 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.357545 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.357545 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.357545 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.357336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358101 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358329 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358407 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358367 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358461 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358512 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-config\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358512 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358612 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358527 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73980114-ba3f-469b-a4e1-e201802346d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358612 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358612 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358762 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358747 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358830 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358746 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358887 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358848 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358965 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358965 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.358965 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.358955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7nnf\" (UniqueName: \"kubernetes.io/projected/73980114-ba3f-469b-a4e1-e201802346d1-kube-api-access-f7nnf\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.360700 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.360131 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/73980114-ba3f-469b-a4e1-e201802346d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.360700 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.360364 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.360700 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.360488 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.360700 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.360613 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.360700 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.360680 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.361848 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.361543 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.361848 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.361623 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.361848 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.361833 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.362164 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.362141 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/73980114-ba3f-469b-a4e1-e201802346d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.362358 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.362334 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/73980114-ba3f-469b-a4e1-e201802346d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.362604 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.362586 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.363124 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.363107 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.363342 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.363321 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.363442 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.363423 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.363899 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.363881 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/73980114-ba3f-469b-a4e1-e201802346d1-config\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.372761 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.372744 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7nnf\" (UniqueName: \"kubernetes.io/projected/73980114-ba3f-469b-a4e1-e201802346d1-kube-api-access-f7nnf\") pod \"prometheus-k8s-0\" (UID: \"73980114-ba3f-469b-a4e1-e201802346d1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.460894 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.460868 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:36:16.773828 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:16.773792 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 10 02:36:16.777652 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:36:16.777623 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73980114_ba3f_469b_a4e1_e201802346d1.slice/crio-518a2d09262c7b6c1ba6ffe9489e42a037b127d2c3ad888930bdbb6f4c148c7e WatchSource:0}: Error finding container 518a2d09262c7b6c1ba6ffe9489e42a037b127d2c3ad888930bdbb6f4c148c7e: Status 404 returned error can't find the container with id 518a2d09262c7b6c1ba6ffe9489e42a037b127d2c3ad888930bdbb6f4c148c7e Sep 10 02:36:17.086782 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:17.086694 2559 generic.go:356] "Generic (PLEG): container finished" podID="73980114-ba3f-469b-a4e1-e201802346d1" containerID="b8fdff0413f230b171f8bef48ffdc1cb9baea271272c90052c061925c01156f3" exitCode=0 Sep 10 02:36:17.086975 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:17.086780 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73980114-ba3f-469b-a4e1-e201802346d1","Type":"ContainerDied","Data":"b8fdff0413f230b171f8bef48ffdc1cb9baea271272c90052c061925c01156f3"} Sep 10 02:36:17.086975 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:17.086855 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73980114-ba3f-469b-a4e1-e201802346d1","Type":"ContainerStarted","Data":"518a2d09262c7b6c1ba6ffe9489e42a037b127d2c3ad888930bdbb6f4c148c7e"} Sep 10 02:36:18.094863 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:18.094824 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73980114-ba3f-469b-a4e1-e201802346d1","Type":"ContainerStarted","Data":"704492fa45f2197f29ea300588fbd51084306548b8290b598ecb0e36303a54a3"} Sep 10 02:36:18.095270 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:18.094973 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73980114-ba3f-469b-a4e1-e201802346d1","Type":"ContainerStarted","Data":"d24d4814edec65fdade2fd61d8006c71b4b0e744b136befe71398c3845d176ff"} Sep 10 02:36:18.095270 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:18.095023 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73980114-ba3f-469b-a4e1-e201802346d1","Type":"ContainerStarted","Data":"e177c60e4348cf4d98d03d8b43cfd4c8e68dce8f33186af3e66edd47dd816a7e"} Sep 10 02:36:18.095270 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:18.095058 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73980114-ba3f-469b-a4e1-e201802346d1","Type":"ContainerStarted","Data":"75fb3000f984cae1503c7b56dcce0076889f07b42c21b121a2f3c166234e98f3"} Sep 10 02:36:18.095270 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:18.095093 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73980114-ba3f-469b-a4e1-e201802346d1","Type":"ContainerStarted","Data":"a4e1c2e2a180547aec46ee0730a3f20860ceedca73861cdae0f9e5d69bb0c79a"} Sep 10 02:36:18.095270 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:18.095131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"73980114-ba3f-469b-a4e1-e201802346d1","Type":"ContainerStarted","Data":"0b145fb6faaca570304a8ca1b985c544839b2723fd66d26f0596ba6f7cf3bb6e"} Sep 10 02:36:18.151515 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:18.151466 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.129444308 podStartE2EDuration="2.151450036s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.005728ms" isStatefulPod=false podCreationTimestamp="2026-09-10 02:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:36:18.148736284 +0000 UTC m=+144.363721807" watchObservedRunningTime="2026-09-10 02:36:18.151450036 +0000 UTC m=+144.366435560" Sep 10 02:36:21.461063 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:36:21.461023 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:37:16.462078 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:37:16.462037 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:37:16.479266 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:37:16.479239 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:37:17.326683 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:37:17.326656 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 10 02:38:25.152847 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.152799 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp"] Sep 10 02:38:25.155107 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.155082 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" Sep 10 02:38:25.157712 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.157686 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 02:38:25.157823 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.157718 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 02:38:25.157823 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.157721 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bt27s\"" Sep 10 02:38:25.164508 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.164485 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp"] Sep 10 02:38:25.201682 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.201656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-695vp\" (UID: \"0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" Sep 10 02:38:25.201789 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.201696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpjws\" (UniqueName: \"kubernetes.io/projected/0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d-kube-api-access-vpjws\") pod \"openshift-lws-operator-fd8ccff4c-695vp\" (UID: \"0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" Sep 10 02:38:25.302282 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.302259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-695vp\" (UID: \"0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" Sep 10 02:38:25.302380 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.302305 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpjws\" (UniqueName: \"kubernetes.io/projected/0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d-kube-api-access-vpjws\") pod \"openshift-lws-operator-fd8ccff4c-695vp\" (UID: \"0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" Sep 10 02:38:25.302600 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.302582 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-695vp\" (UID: \"0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" Sep 10 02:38:25.315331 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.315310 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpjws\" (UniqueName: \"kubernetes.io/projected/0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d-kube-api-access-vpjws\") pod \"openshift-lws-operator-fd8ccff4c-695vp\" (UID: \"0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" Sep 10 02:38:25.479307 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.479252 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" Sep 10 02:38:25.749029 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:25.749003 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp"] Sep 10 02:38:25.751849 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:38:25.751825 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d3cb986_1ebc_4ac6_bcd7_c8e664154a5d.slice/crio-fa56f7622eafc807644a00a9362a697d82677160ef5ca4c85be46d0375303a59 WatchSource:0}: Error finding container fa56f7622eafc807644a00a9362a697d82677160ef5ca4c85be46d0375303a59: Status 404 returned error can't find the container with id fa56f7622eafc807644a00a9362a697d82677160ef5ca4c85be46d0375303a59 Sep 10 02:38:26.572075 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:26.572035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" event={"ID":"0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d","Type":"ContainerStarted","Data":"fa56f7622eafc807644a00a9362a697d82677160ef5ca4c85be46d0375303a59"} Sep 10 02:38:28.582565 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:28.582470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" event={"ID":"0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d","Type":"ContainerStarted","Data":"a38f74e56af82486f8c88af409adfd6fc9d8e50495c02103ab1237f44d8c657f"} Sep 10 02:38:28.599964 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:28.599898 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-695vp" podStartSLOduration=1.166374281 podStartE2EDuration="3.599883771s" totalImagesPullingTime="2.43350949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:28.59928081 +0000 UTC m=+274.814266333" watchObservedRunningTime="2026-09-10 02:38:28.599883771 +0000 UTC m=+274.814869294" Sep 10 02:38:49.387458 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.387420 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr"] Sep 10 02:38:49.391206 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.391187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.401109 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.401091 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 02:38:49.401516 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.401502 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 02:38:49.401594 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.401504 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 02:38:49.402331 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.402309 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rwkzf\"" Sep 10 02:38:49.402419 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.402330 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 02:38:49.429113 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.429088 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr"] Sep 10 02:38:49.471290 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.471271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk9vj\" (UniqueName: \"kubernetes.io/projected/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-kube-api-access-bk9vj\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.471399 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.471305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-manifests\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.471399 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.471324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.471399 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.471340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.471522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.471416 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-tmp\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.572770 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.572745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-manifests\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.572878 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.572772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.572878 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.572792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.572878 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.572817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-tmp\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.573077 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.572897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk9vj\" (UniqueName: \"kubernetes.io/projected/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-kube-api-access-bk9vj\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.573244 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.573218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-manifests\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.575369 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.575344 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-tmp\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.575447 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.575434 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.575572 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.575557 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.591271 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.591245 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk9vj\" (UniqueName: \"kubernetes.io/projected/e85a46e8-6f47-4781-a5a1-b38a6063c6fa-kube-api-access-bk9vj\") pod \"opendatahub-operator-controller-manager-647784d6dd-8lpbr\" (UID: \"e85a46e8-6f47-4781-a5a1-b38a6063c6fa\") " pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.605801 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.605776 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh"] Sep 10 02:38:49.608974 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.608961 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.611886 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.611869 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 02:38:49.612041 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.612025 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 02:38:49.612228 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.612210 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2dwg7\"" Sep 10 02:38:49.612278 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.612258 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 02:38:49.626208 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.626189 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh"] Sep 10 02:38:49.673393 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.673342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be6a77e8-8f47-46dc-b162-4457a6227f61-cert\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.673393 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.673383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be6a77e8-8f47-46dc-b162-4457a6227f61-manager-config\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.673507 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.673404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be6a77e8-8f47-46dc-b162-4457a6227f61-metrics-cert\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.673507 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.673486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h45l5\" (UniqueName: \"kubernetes.io/projected/be6a77e8-8f47-46dc-b162-4457a6227f61-kube-api-access-h45l5\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.700400 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.700376 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:49.774687 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.774663 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be6a77e8-8f47-46dc-b162-4457a6227f61-manager-config\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.774811 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.774691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be6a77e8-8f47-46dc-b162-4457a6227f61-metrics-cert\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.774811 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.774720 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h45l5\" (UniqueName: \"kubernetes.io/projected/be6a77e8-8f47-46dc-b162-4457a6227f61-kube-api-access-h45l5\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.774811 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.774754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be6a77e8-8f47-46dc-b162-4457a6227f61-cert\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.775541 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.775512 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be6a77e8-8f47-46dc-b162-4457a6227f61-manager-config\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.777830 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.777809 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be6a77e8-8f47-46dc-b162-4457a6227f61-cert\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.777907 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.777858 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be6a77e8-8f47-46dc-b162-4457a6227f61-metrics-cert\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.787869 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.787851 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45l5\" (UniqueName: \"kubernetes.io/projected/be6a77e8-8f47-46dc-b162-4457a6227f61-kube-api-access-h45l5\") pod \"lws-controller-manager-748c765c7f-tdhmh\" (UID: \"be6a77e8-8f47-46dc-b162-4457a6227f61\") " pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:49.917575 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:49.917550 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:50.001984 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:50.001957 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr"] Sep 10 02:38:50.003507 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:38:50.003483 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85a46e8_6f47_4781_a5a1_b38a6063c6fa.slice/crio-5778e230adf7a539c66d1d1edb76fb908d5a8bede63bddc494c597694ea7c19b WatchSource:0}: Error finding container 5778e230adf7a539c66d1d1edb76fb908d5a8bede63bddc494c597694ea7c19b: Status 404 returned error can't find the container with id 5778e230adf7a539c66d1d1edb76fb908d5a8bede63bddc494c597694ea7c19b Sep 10 02:38:50.191178 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:50.191154 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh"] Sep 10 02:38:50.193311 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:38:50.193287 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6a77e8_8f47_46dc_b162_4457a6227f61.slice/crio-4f56683114f5560444854f205733e468eebe9debe33d455e1b4865f07391f701 WatchSource:0}: Error finding container 4f56683114f5560444854f205733e468eebe9debe33d455e1b4865f07391f701: Status 404 returned error can't find the container with id 4f56683114f5560444854f205733e468eebe9debe33d455e1b4865f07391f701 Sep 10 02:38:50.672963 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:50.672906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" event={"ID":"e85a46e8-6f47-4781-a5a1-b38a6063c6fa","Type":"ContainerStarted","Data":"5778e230adf7a539c66d1d1edb76fb908d5a8bede63bddc494c597694ea7c19b"} Sep 10 02:38:50.674423 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:50.674396 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" event={"ID":"be6a77e8-8f47-46dc-b162-4457a6227f61","Type":"ContainerStarted","Data":"4f56683114f5560444854f205733e468eebe9debe33d455e1b4865f07391f701"} Sep 10 02:38:53.691228 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:53.691199 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" event={"ID":"be6a77e8-8f47-46dc-b162-4457a6227f61","Type":"ContainerStarted","Data":"2372aeae3e51042dc8cfc00f055b670f10cdfef7139e82d09a581c0ee2e73a63"} Sep 10 02:38:53.691609 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:53.691307 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:38:53.692974 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:53.692954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" event={"ID":"e85a46e8-6f47-4781-a5a1-b38a6063c6fa","Type":"ContainerStarted","Data":"0d37ddd6cfad9b0139e72a0a4791673dafd736ac4c446ea60d0fe67ee78ca669"} Sep 10 02:38:53.732713 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:53.732672 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" podStartSLOduration=1.61910793 podStartE2EDuration="4.732658636s" totalImagesPullingTime="3.113550706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:53.710868587 +0000 UTC m=+299.925854111" watchObservedRunningTime="2026-09-10 02:38:53.732658636 +0000 UTC m=+299.947644158" Sep 10 02:38:54.157044 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:54.157021 2559 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 02:38:54.699113 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:54.699084 2559 generic.go:356] "Generic (PLEG): container finished" podID="e85a46e8-6f47-4781-a5a1-b38a6063c6fa" containerID="0d37ddd6cfad9b0139e72a0a4791673dafd736ac4c446ea60d0fe67ee78ca669" exitCode=0 Sep 10 02:38:54.699522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:54.699170 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" event={"ID":"e85a46e8-6f47-4781-a5a1-b38a6063c6fa","Type":"ContainerDied","Data":"0d37ddd6cfad9b0139e72a0a4791673dafd736ac4c446ea60d0fe67ee78ca669"} Sep 10 02:38:55.706030 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:55.705992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" event={"ID":"e85a46e8-6f47-4781-a5a1-b38a6063c6fa","Type":"ContainerStarted","Data":"0357628af86725debfd0c48e8cbcfe42547bd0307589e6f66de7179436eeb19b"} Sep 10 02:38:55.706502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:55.706116 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:38:55.729828 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:38:55.729783 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" podStartSLOduration=2.100798833 podStartE2EDuration="6.729767159s" totalImagesPullingTime="3.614888542s" totalInitContainerRuntime="1.014079784s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:38:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:38:55.72925789 +0000 UTC m=+301.944243413" watchObservedRunningTime="2026-09-10 02:38:55.729767159 +0000 UTC m=+301.944752681" Sep 10 02:39:04.701904 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:04.701876 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-748c765c7f-tdhmh" Sep 10 02:39:06.712361 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:06.712325 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-647784d6dd-8lpbr" Sep 10 02:39:10.785922 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.785892 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc"] Sep 10 02:39:10.793577 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.793557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:10.796455 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.796423 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 02:39:10.796602 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.796455 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 02:39:10.796602 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.796469 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 02:39:10.796602 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.796469 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jjzbt\"" Sep 10 02:39:10.797436 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.797419 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 02:39:10.800260 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.800240 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc"] Sep 10 02:39:10.937149 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.937127 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tmp\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:10.937244 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.937158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vmxj\" (UniqueName: \"kubernetes.io/projected/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-kube-api-access-9vmxj\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:10.937244 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:10.937219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tls-certs\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.037829 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.037769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tls-certs\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.037953 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.037840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tmp\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.037953 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.037868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vmxj\" (UniqueName: \"kubernetes.io/projected/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-kube-api-access-9vmxj\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.037953 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:39:11.037911 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 10 02:39:11.038117 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:39:11.037997 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tls-certs podName:1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156 nodeName:}" failed. No retries permitted until 2026-09-10 02:39:11.537981075 +0000 UTC m=+317.752966575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tls-certs") pod "kube-auth-proxy-74d6b6cf86-hgkhc" (UID: "1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156") : secret "kube-auth-proxy-tls" not found Sep 10 02:39:11.040239 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.040220 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tmp\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.049043 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.049021 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vmxj\" (UniqueName: \"kubernetes.io/projected/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-kube-api-access-9vmxj\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.542415 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.542391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tls-certs\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.544575 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.544550 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156-tls-certs\") pod \"kube-auth-proxy-74d6b6cf86-hgkhc\" (UID: \"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156\") " pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.704510 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.704489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" Sep 10 02:39:11.981866 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.981827 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc"] Sep 10 02:39:11.985217 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:39:11.985191 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4d3f8c_4fd1_4eb3_9d2a_4d8462718156.slice/crio-3f505988801dd6c67c61e4adf94eb715bd1770a0b93b47867f872e5789e5f99e WatchSource:0}: Error finding container 3f505988801dd6c67c61e4adf94eb715bd1770a0b93b47867f872e5789e5f99e: Status 404 returned error can't find the container with id 3f505988801dd6c67c61e4adf94eb715bd1770a0b93b47867f872e5789e5f99e Sep 10 02:39:11.987270 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:11.987254 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 02:39:12.780669 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:12.780593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" event={"ID":"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156","Type":"ContainerStarted","Data":"3f505988801dd6c67c61e4adf94eb715bd1770a0b93b47867f872e5789e5f99e"} Sep 10 02:39:14.790941 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:14.790900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" event={"ID":"1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156","Type":"ContainerStarted","Data":"d2026c43f9f0116a3abaf5b75db5fa5afd477cd5f07faf1042c4f990e0f71b2b"} Sep 10 02:39:14.809972 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:39:14.809910 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74d6b6cf86-hgkhc" podStartSLOduration=2.103105887 podStartE2EDuration="4.809890855s" totalImagesPullingTime="2.706784968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:39:14.809545869 +0000 UTC m=+321.024531391" watchObservedRunningTime="2026-09-10 02:39:14.809890855 +0000 UTC m=+321.024876378" Sep 10 02:40:50.186396 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.186360 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv"] Sep 10 02:40:50.189559 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.189542 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.192785 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.192760 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 02:40:50.192953 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.192810 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 02:40:50.192953 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.192811 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 10 02:40:50.193838 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.193820 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4s7v6\"" Sep 10 02:40:50.193838 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.193834 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 10 02:40:50.206493 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.206465 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv"] Sep 10 02:40:50.248359 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.248339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.248479 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.248366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.248479 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.248396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6htzh\" (UniqueName: \"kubernetes.io/projected/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-kube-api-access-6htzh\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.348921 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.348899 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6htzh\" (UniqueName: \"kubernetes.io/projected/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-kube-api-access-6htzh\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.349037 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.348997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.349037 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.349024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.349604 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.349583 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.351568 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.351547 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.359178 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.359157 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6htzh\" (UniqueName: \"kubernetes.io/projected/39cef7a1-1c66-4d2d-8221-f1fd8b7581b3-kube-api-access-6htzh\") pod \"kuadrant-console-plugin-fbdd4f445-rx6tv\" (UID: \"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.499375 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.499311 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" Sep 10 02:40:50.773497 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:50.773468 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv"] Sep 10 02:40:50.778009 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:40:50.777961 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39cef7a1_1c66_4d2d_8221_f1fd8b7581b3.slice/crio-eceb828bccbf5b6808f8b5c3bf7327c9eb6653ce5fc2097afb076f7238bd5cee WatchSource:0}: Error finding container eceb828bccbf5b6808f8b5c3bf7327c9eb6653ce5fc2097afb076f7238bd5cee: Status 404 returned error can't find the container with id eceb828bccbf5b6808f8b5c3bf7327c9eb6653ce5fc2097afb076f7238bd5cee Sep 10 02:40:51.227166 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:51.227138 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" event={"ID":"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3","Type":"ContainerStarted","Data":"eceb828bccbf5b6808f8b5c3bf7327c9eb6653ce5fc2097afb076f7238bd5cee"} Sep 10 02:40:56.265592 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:56.265545 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" event={"ID":"39cef7a1-1c66-4d2d-8221-f1fd8b7581b3","Type":"ContainerStarted","Data":"f801f176728194acc59e8b5a641f3bed25f49e82c231a4cf74e84e7cd3cd99d1"} Sep 10 02:40:56.278901 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:40:56.278840 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-rx6tv" podStartSLOduration=1.6814991670000001 podStartE2EDuration="6.278821484s" totalImagesPullingTime="4.597322317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:40:56.278258221 +0000 UTC m=+422.493243745" watchObservedRunningTime="2026-09-10 02:40:56.278821484 +0000 UTC m=+422.493807006" Sep 10 02:41:02.006105 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.006067 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j"] Sep 10 02:41:02.009981 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.009953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:02.013456 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.013431 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fbrpl\"" Sep 10 02:41:02.030080 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.030046 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j"] Sep 10 02:41:02.147783 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.147739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skrjf\" (UniqueName: \"kubernetes.io/projected/67d056fc-d532-46d7-abbd-0255e13cac06-kube-api-access-skrjf\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7gg6j\" (UID: \"67d056fc-d532-46d7-abbd-0255e13cac06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:02.147783 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.147787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67d056fc-d532-46d7-abbd-0255e13cac06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7gg6j\" (UID: \"67d056fc-d532-46d7-abbd-0255e13cac06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:02.248525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.248474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67d056fc-d532-46d7-abbd-0255e13cac06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7gg6j\" (UID: \"67d056fc-d532-46d7-abbd-0255e13cac06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:02.248660 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.248567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skrjf\" (UniqueName: \"kubernetes.io/projected/67d056fc-d532-46d7-abbd-0255e13cac06-kube-api-access-skrjf\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7gg6j\" (UID: \"67d056fc-d532-46d7-abbd-0255e13cac06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:02.248968 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.248916 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67d056fc-d532-46d7-abbd-0255e13cac06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7gg6j\" (UID: \"67d056fc-d532-46d7-abbd-0255e13cac06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:02.263872 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.263799 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skrjf\" (UniqueName: \"kubernetes.io/projected/67d056fc-d532-46d7-abbd-0255e13cac06-kube-api-access-skrjf\") pod \"kuadrant-operator-controller-manager-5769f99d9f-7gg6j\" (UID: \"67d056fc-d532-46d7-abbd-0255e13cac06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:02.320297 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.320257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:02.605870 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:02.605844 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j"] Sep 10 02:41:02.607951 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:41:02.607898 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d056fc_d532_46d7_abbd_0255e13cac06.slice/crio-6e131fdf5faed747e0bb23a615d8e57c618d7c6793d622cb6af4f1ab2928725f WatchSource:0}: Error finding container 6e131fdf5faed747e0bb23a615d8e57c618d7c6793d622cb6af4f1ab2928725f: Status 404 returned error can't find the container with id 6e131fdf5faed747e0bb23a615d8e57c618d7c6793d622cb6af4f1ab2928725f Sep 10 02:41:03.288161 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:03.288128 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" event={"ID":"67d056fc-d532-46d7-abbd-0255e13cac06","Type":"ContainerStarted","Data":"6e131fdf5faed747e0bb23a615d8e57c618d7c6793d622cb6af4f1ab2928725f"} Sep 10 02:41:07.310451 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:07.310415 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" event={"ID":"67d056fc-d532-46d7-abbd-0255e13cac06","Type":"ContainerStarted","Data":"1e201075eed10b2c385344735cfea0ee2c5042d317b5a23cf406c1807b612b0c"} Sep 10 02:41:07.310899 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:07.310542 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:07.333424 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:07.333369 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" podStartSLOduration=2.205407263 podStartE2EDuration="6.333349898s" totalImagesPullingTime="4.127942635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:41:07.331012197 +0000 UTC m=+433.545997720" watchObservedRunningTime="2026-09-10 02:41:07.333349898 +0000 UTC m=+433.548335421" Sep 10 02:41:18.319381 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:18.319346 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-7gg6j" Sep 10 02:41:40.079225 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.079189 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:41:40.096014 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.095974 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:41:40.096189 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.096087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:40.098859 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.098834 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 02:41:40.112525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.112500 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:41:40.179520 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.179489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl88z\" (UniqueName: \"kubernetes.io/projected/13648fa6-73dc-425b-8473-595926c7dd2a-kube-api-access-jl88z\") pod \"limitador-limitador-84994f7ffc-qnmnz\" (UID: \"13648fa6-73dc-425b-8473-595926c7dd2a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:40.179669 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.179599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13648fa6-73dc-425b-8473-595926c7dd2a-config-file\") pod \"limitador-limitador-84994f7ffc-qnmnz\" (UID: \"13648fa6-73dc-425b-8473-595926c7dd2a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:40.280432 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.280401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13648fa6-73dc-425b-8473-595926c7dd2a-config-file\") pod \"limitador-limitador-84994f7ffc-qnmnz\" (UID: \"13648fa6-73dc-425b-8473-595926c7dd2a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:40.280432 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.280436 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl88z\" (UniqueName: \"kubernetes.io/projected/13648fa6-73dc-425b-8473-595926c7dd2a-kube-api-access-jl88z\") pod \"limitador-limitador-84994f7ffc-qnmnz\" (UID: \"13648fa6-73dc-425b-8473-595926c7dd2a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:40.281107 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.281087 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13648fa6-73dc-425b-8473-595926c7dd2a-config-file\") pod \"limitador-limitador-84994f7ffc-qnmnz\" (UID: \"13648fa6-73dc-425b-8473-595926c7dd2a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:40.296441 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.296413 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl88z\" (UniqueName: \"kubernetes.io/projected/13648fa6-73dc-425b-8473-595926c7dd2a-kube-api-access-jl88z\") pod \"limitador-limitador-84994f7ffc-qnmnz\" (UID: \"13648fa6-73dc-425b-8473-595926c7dd2a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:40.406582 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.406545 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:40.679313 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:40.679286 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:41:40.682139 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:41:40.682114 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13648fa6_73dc_425b_8473_595926c7dd2a.slice/crio-69f27ce64b138f82594859a83922c6acc2187803b6a6b5f11fac7087b9f8b62a WatchSource:0}: Error finding container 69f27ce64b138f82594859a83922c6acc2187803b6a6b5f11fac7087b9f8b62a: Status 404 returned error can't find the container with id 69f27ce64b138f82594859a83922c6acc2187803b6a6b5f11fac7087b9f8b62a Sep 10 02:41:41.460727 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:41.460689 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" event={"ID":"13648fa6-73dc-425b-8473-595926c7dd2a","Type":"ContainerStarted","Data":"69f27ce64b138f82594859a83922c6acc2187803b6a6b5f11fac7087b9f8b62a"} Sep 10 02:41:42.466011 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:42.465974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" event={"ID":"13648fa6-73dc-425b-8473-595926c7dd2a","Type":"ContainerStarted","Data":"75d1de980ab9d5bf5e67e51efc218a6b1a84d01751d3c44de62de31f4e917393"} Sep 10 02:41:42.466477 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:42.466088 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:41:42.482369 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:42.482317 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" podStartSLOduration=1.532262374 podStartE2EDuration="2.482297501s" totalImagesPullingTime="950.035127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:41:42.482058958 +0000 UTC m=+468.697044495" watchObservedRunningTime="2026-09-10 02:41:42.482297501 +0000 UTC m=+468.697283024" Sep 10 02:41:53.472082 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:41:53.472048 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-qnmnz" Sep 10 02:42:09.449033 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.448994 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xvxj7"] Sep 10 02:42:09.452740 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.452722 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:09.455500 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.455472 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nfn99\"" Sep 10 02:42:09.465975 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.465953 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 02:42:09.488949 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.488900 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xvxj7"] Sep 10 02:42:09.628449 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.628409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5scv\" (UniqueName: \"kubernetes.io/projected/c10fbbab-c112-474b-9831-e915adcf3401-kube-api-access-q5scv\") pod \"authorino-6d4dfc649f-xvxj7\" (UID: \"c10fbbab-c112-474b-9831-e915adcf3401\") " pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:09.628623 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.628460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c10fbbab-c112-474b-9831-e915adcf3401-tls-cert\") pod \"authorino-6d4dfc649f-xvxj7\" (UID: \"c10fbbab-c112-474b-9831-e915adcf3401\") " pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:09.654525 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.654486 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xvxj7"] Sep 10 02:42:09.654769 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:42:09.654749 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-q5scv tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" podUID="c10fbbab-c112-474b-9831-e915adcf3401" Sep 10 02:42:09.729242 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.729155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5scv\" (UniqueName: \"kubernetes.io/projected/c10fbbab-c112-474b-9831-e915adcf3401-kube-api-access-q5scv\") pod \"authorino-6d4dfc649f-xvxj7\" (UID: \"c10fbbab-c112-474b-9831-e915adcf3401\") " pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:09.729242 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.729202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c10fbbab-c112-474b-9831-e915adcf3401-tls-cert\") pod \"authorino-6d4dfc649f-xvxj7\" (UID: \"c10fbbab-c112-474b-9831-e915adcf3401\") " pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:09.731786 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.731751 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c10fbbab-c112-474b-9831-e915adcf3401-tls-cert\") pod \"authorino-6d4dfc649f-xvxj7\" (UID: \"c10fbbab-c112-474b-9831-e915adcf3401\") " pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:09.737647 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:09.737619 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5scv\" (UniqueName: \"kubernetes.io/projected/c10fbbab-c112-474b-9831-e915adcf3401-kube-api-access-q5scv\") pod \"authorino-6d4dfc649f-xvxj7\" (UID: \"c10fbbab-c112-474b-9831-e915adcf3401\") " pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:10.590198 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:10.590165 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:10.597579 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:10.597553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:10.739540 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:10.739493 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c10fbbab-c112-474b-9831-e915adcf3401-tls-cert\") pod \"c10fbbab-c112-474b-9831-e915adcf3401\" (UID: \"c10fbbab-c112-474b-9831-e915adcf3401\") " Sep 10 02:42:10.739766 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:10.739748 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5scv\" (UniqueName: \"kubernetes.io/projected/c10fbbab-c112-474b-9831-e915adcf3401-kube-api-access-q5scv\") pod \"c10fbbab-c112-474b-9831-e915adcf3401\" (UID: \"c10fbbab-c112-474b-9831-e915adcf3401\") " Sep 10 02:42:10.742010 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:10.741981 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c10fbbab-c112-474b-9831-e915adcf3401-kube-api-access-q5scv" (OuterVolumeSpecName: "kube-api-access-q5scv") pod "c10fbbab-c112-474b-9831-e915adcf3401" (UID: "c10fbbab-c112-474b-9831-e915adcf3401"). InnerVolumeSpecName "kube-api-access-q5scv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 02:42:10.742137 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:10.742047 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c10fbbab-c112-474b-9831-e915adcf3401-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c10fbbab-c112-474b-9831-e915adcf3401" (UID: "c10fbbab-c112-474b-9831-e915adcf3401"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 02:42:10.840578 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:10.840476 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c10fbbab-c112-474b-9831-e915adcf3401-tls-cert\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:42:10.840578 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:10.840515 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5scv\" (UniqueName: \"kubernetes.io/projected/c10fbbab-c112-474b-9831-e915adcf3401-kube-api-access-q5scv\") on node \"ip-10-0-143-27.ec2.internal\" DevicePath \"\"" Sep 10 02:42:11.594702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:11.594667 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-xvxj7" Sep 10 02:42:11.647976 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:11.647918 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xvxj7"] Sep 10 02:42:11.652273 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:11.652236 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-xvxj7"] Sep 10 02:42:12.266375 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:12.266335 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c10fbbab-c112-474b-9831-e915adcf3401" path="/var/lib/kubelet/pods/c10fbbab-c112-474b-9831-e915adcf3401/volumes" Sep 10 02:42:55.931350 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:42:55.931277 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:43:14.869054 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:14.869019 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:43:18.144474 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:18.144435 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:43:22.745312 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:22.745268 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:43:35.298683 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.298642 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6"] Sep 10 02:43:35.303046 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.303018 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.307163 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.307134 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g7ctp\"" Sep 10 02:43:35.307329 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.307180 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 02:43:35.307329 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.307205 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 02:43:35.307567 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.307550 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 02:43:35.313517 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.313488 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6"] Sep 10 02:43:35.390195 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.390171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5pt\" (UniqueName: \"kubernetes.io/projected/8681786f-c4d0-4a02-98ff-77eba7667ec3-kube-api-access-nv5pt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.390323 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.390208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.390323 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.390237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.390323 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.390259 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.390323 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.390304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8681786f-c4d0-4a02-98ff-77eba7667ec3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.390323 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.390325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491347 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491466 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491358 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8681786f-c4d0-4a02-98ff-77eba7667ec3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491466 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491584 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491493 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5pt\" (UniqueName: \"kubernetes.io/projected/8681786f-c4d0-4a02-98ff-77eba7667ec3-kube-api-access-nv5pt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491584 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491694 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491796 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491777 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491849 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491813 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.491884 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.491857 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.493831 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.493814 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8681786f-c4d0-4a02-98ff-77eba7667ec3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.494168 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.494152 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8681786f-c4d0-4a02-98ff-77eba7667ec3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.499177 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.499158 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5pt\" (UniqueName: \"kubernetes.io/projected/8681786f-c4d0-4a02-98ff-77eba7667ec3-kube-api-access-nv5pt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-hlnw6\" (UID: \"8681786f-c4d0-4a02-98ff-77eba7667ec3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.615485 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.615459 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:35.884598 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.884573 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6"] Sep 10 02:43:35.886246 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:43:35.886218 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8681786f_c4d0_4a02_98ff_77eba7667ec3.slice/crio-1ae0044efd63d8868a9bb8406d1f40aa3e2634f2bd56e936f4bbe756cf491814 WatchSource:0}: Error finding container 1ae0044efd63d8868a9bb8406d1f40aa3e2634f2bd56e936f4bbe756cf491814: Status 404 returned error can't find the container with id 1ae0044efd63d8868a9bb8406d1f40aa3e2634f2bd56e936f4bbe756cf491814 Sep 10 02:43:35.977839 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:35.977809 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" event={"ID":"8681786f-c4d0-4a02-98ff-77eba7667ec3","Type":"ContainerStarted","Data":"1ae0044efd63d8868a9bb8406d1f40aa3e2634f2bd56e936f4bbe756cf491814"} Sep 10 02:43:36.739621 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:36.739588 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:43:36.984287 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:36.984210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" event={"ID":"8681786f-c4d0-4a02-98ff-77eba7667ec3","Type":"ContainerStarted","Data":"b252382e08ecc6d7c57763ae07bc597f17ef34bef2f551d450baadb6f66c0044"} Sep 10 02:43:37.001511 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:37.001430 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" podStartSLOduration=0.991164422 podStartE2EDuration="2.001410957s" totalImagesPullingTime="1.010246535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:43:37.000521741 +0000 UTC m=+583.215507293" watchObservedRunningTime="2026-09-10 02:43:37.001410957 +0000 UTC m=+583.216396481" Sep 10 02:43:44.942428 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:44.942396 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:43:45.616447 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:45.616412 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:45.616606 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:45.616498 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:45.628795 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:45.628772 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:46.036200 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:46.036136 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-hlnw6" Sep 10 02:43:52.040541 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:52.040509 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:43:57.004608 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.004574 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd"] Sep 10 02:43:57.007970 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.007946 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.010279 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.010251 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 10 02:43:57.017720 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.017700 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd"] Sep 10 02:43:57.052026 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.051996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.052166 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.052039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.052166 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.052125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.052166 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.052147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26f33b87-122b-41a6-b544-0b99cd53a7e4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.052308 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.052177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.052308 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.052210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p46cr\" (UniqueName: \"kubernetes.io/projected/26f33b87-122b-41a6-b544-0b99cd53a7e4-kube-api-access-p46cr\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153311 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153311 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26f33b87-122b-41a6-b544-0b99cd53a7e4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153505 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153505 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p46cr\" (UniqueName: \"kubernetes.io/projected/26f33b87-122b-41a6-b544-0b99cd53a7e4-kube-api-access-p46cr\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153505 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153505 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153428 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153806 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153876 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153814 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.153961 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.153873 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.155755 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.155730 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26f33b87-122b-41a6-b544-0b99cd53a7e4-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.156130 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.156107 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26f33b87-122b-41a6-b544-0b99cd53a7e4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.163337 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.163315 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p46cr\" (UniqueName: \"kubernetes.io/projected/26f33b87-122b-41a6-b544-0b99cd53a7e4-kube-api-access-p46cr\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd\" (UID: \"26f33b87-122b-41a6-b544-0b99cd53a7e4\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.317634 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.317583 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:43:57.590652 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:57.590628 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd"] Sep 10 02:43:57.592606 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:43:57.592579 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26f33b87_122b_41a6_b544_0b99cd53a7e4.slice/crio-7ce7f678636904f893d4159021ef52691c8b3bb09d6d89715c63e92998c1dd10 WatchSource:0}: Error finding container 7ce7f678636904f893d4159021ef52691c8b3bb09d6d89715c63e92998c1dd10: Status 404 returned error can't find the container with id 7ce7f678636904f893d4159021ef52691c8b3bb09d6d89715c63e92998c1dd10 Sep 10 02:43:58.078521 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:58.078486 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f33b87-122b-41a6-b544-0b99cd53a7e4" containerID="2c8ea135cfbe38268840fb16afd9bbf8df13cae59cf366bd7f8adce0fa54887a" exitCode=0 Sep 10 02:43:58.078907 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:58.078579 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" event={"ID":"26f33b87-122b-41a6-b544-0b99cd53a7e4","Type":"ContainerDied","Data":"2c8ea135cfbe38268840fb16afd9bbf8df13cae59cf366bd7f8adce0fa54887a"} Sep 10 02:43:58.078907 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:58.078639 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" event={"ID":"26f33b87-122b-41a6-b544-0b99cd53a7e4","Type":"ContainerStarted","Data":"7ce7f678636904f893d4159021ef52691c8b3bb09d6d89715c63e92998c1dd10"} Sep 10 02:43:58.078907 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:58.078747 2559 scope.go:117] "RemoveContainer" containerID="2c8ea135cfbe38268840fb16afd9bbf8df13cae59cf366bd7f8adce0fa54887a" Sep 10 02:43:59.085555 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:59.085521 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f33b87-122b-41a6-b544-0b99cd53a7e4" containerID="08a0d723cddd4772f4f1d16cd528d249ec9145771df817e8d3ece0ef47b704aa" exitCode=0 Sep 10 02:43:59.086051 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:59.085566 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" event={"ID":"26f33b87-122b-41a6-b544-0b99cd53a7e4","Type":"ContainerDied","Data":"08a0d723cddd4772f4f1d16cd528d249ec9145771df817e8d3ece0ef47b704aa"} Sep 10 02:43:59.086051 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:59.085607 2559 scope.go:117] "RemoveContainer" containerID="2c8ea135cfbe38268840fb16afd9bbf8df13cae59cf366bd7f8adce0fa54887a" Sep 10 02:43:59.086051 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:59.085885 2559 scope.go:117] "RemoveContainer" containerID="08a0d723cddd4772f4f1d16cd528d249ec9145771df817e8d3ece0ef47b704aa" Sep 10 02:43:59.086189 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:43:59.086168 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:43:59.152659 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:43:59.152629 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-qnmnz"] Sep 10 02:44:00.091657 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:00.091625 2559 scope.go:117] "RemoveContainer" containerID="08a0d723cddd4772f4f1d16cd528d249ec9145771df817e8d3ece0ef47b704aa" Sep 10 02:44:00.092152 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:44:00.091815 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:44:07.318016 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:07.317985 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:07.318384 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:07.318038 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:07.318384 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:07.318051 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:07.318384 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:07.318060 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:07.318384 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:07.318333 2559 scope.go:117] "RemoveContainer" containerID="08a0d723cddd4772f4f1d16cd528d249ec9145771df817e8d3ece0ef47b704aa" Sep 10 02:44:07.318548 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:44:07.318468 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:44:08.129866 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:08.129837 2559 scope.go:117] "RemoveContainer" containerID="08a0d723cddd4772f4f1d16cd528d249ec9145771df817e8d3ece0ef47b704aa" Sep 10 02:44:08.130063 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:44:08.130020 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:44:21.260702 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:21.260669 2559 scope.go:117] "RemoveContainer" containerID="08a0d723cddd4772f4f1d16cd528d249ec9145771df817e8d3ece0ef47b704aa" Sep 10 02:44:21.261189 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:21.260914 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 02:44:22.195419 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:22.195382 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f33b87-122b-41a6-b544-0b99cd53a7e4" containerID="fd2bfa52c969e8e18e81078b0c6fa6ea253776c95aac29b4edd8088aaaffc8cb" exitCode=0 Sep 10 02:44:22.195578 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:22.195452 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" event={"ID":"26f33b87-122b-41a6-b544-0b99cd53a7e4","Type":"ContainerDied","Data":"fd2bfa52c969e8e18e81078b0c6fa6ea253776c95aac29b4edd8088aaaffc8cb"} Sep 10 02:44:22.195578 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:22.195509 2559 scope.go:117] "RemoveContainer" containerID="08a0d723cddd4772f4f1d16cd528d249ec9145771df817e8d3ece0ef47b704aa" Sep 10 02:44:22.195913 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:22.195880 2559 scope.go:117] "RemoveContainer" containerID="fd2bfa52c969e8e18e81078b0c6fa6ea253776c95aac29b4edd8088aaaffc8cb" Sep 10 02:44:22.196174 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:44:22.196149 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:44:27.318390 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:27.318363 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:27.318774 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:27.318409 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:27.318774 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:27.318421 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:27.318774 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:27.318429 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:27.318774 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:27.318745 2559 scope.go:117] "RemoveContainer" containerID="fd2bfa52c969e8e18e81078b0c6fa6ea253776c95aac29b4edd8088aaaffc8cb" Sep 10 02:44:27.318958 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:44:27.318910 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:44:41.260863 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:41.260827 2559 scope.go:117] "RemoveContainer" containerID="fd2bfa52c969e8e18e81078b0c6fa6ea253776c95aac29b4edd8088aaaffc8cb" Sep 10 02:44:41.261283 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:44:41.261019 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:44:52.261014 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:52.260980 2559 scope.go:117] "RemoveContainer" containerID="fd2bfa52c969e8e18e81078b0c6fa6ea253776c95aac29b4edd8088aaaffc8cb" Sep 10 02:44:53.347113 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:53.347075 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f33b87-122b-41a6-b544-0b99cd53a7e4" containerID="09b21c52714e055b97dcb58d5fdf3ee96fd80f3715495dd15b1eff2583191158" exitCode=0 Sep 10 02:44:53.347527 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:53.347148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" event={"ID":"26f33b87-122b-41a6-b544-0b99cd53a7e4","Type":"ContainerDied","Data":"09b21c52714e055b97dcb58d5fdf3ee96fd80f3715495dd15b1eff2583191158"} Sep 10 02:44:53.347527 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:53.347205 2559 scope.go:117] "RemoveContainer" containerID="fd2bfa52c969e8e18e81078b0c6fa6ea253776c95aac29b4edd8088aaaffc8cb" Sep 10 02:44:53.347527 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:53.347516 2559 scope.go:117] "RemoveContainer" containerID="09b21c52714e055b97dcb58d5fdf3ee96fd80f3715495dd15b1eff2583191158" Sep 10 02:44:53.347743 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:44:53.347720 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:44:57.317801 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:57.317769 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:57.318175 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:57.317824 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:57.318175 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:57.317838 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:57.318175 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:57.317851 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:44:57.318175 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:44:57.318159 2559 scope.go:117] "RemoveContainer" containerID="09b21c52714e055b97dcb58d5fdf3ee96fd80f3715495dd15b1eff2583191158" Sep 10 02:44:57.318350 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:44:57.318315 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:45:00.143113 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:00.143071 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn"] Sep 10 02:45:00.147868 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:00.147844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" Sep 10 02:45:00.150543 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:00.150512 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dsvwn\"" Sep 10 02:45:00.153249 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:00.153218 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn"] Sep 10 02:45:00.159762 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:00.159738 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" Sep 10 02:45:00.430803 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:00.430631 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn"] Sep 10 02:45:00.432911 ip-10-0-143-27 kubenswrapper[2559]: W0910 02:45:00.432887 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3694818f_4824_42e5_a7fc_f38ce4704ce6.slice/crio-1b827679dce899b010c0357214562016d11bb33ac4dd8c2e0439540fc9ec3b20 WatchSource:0}: Error finding container 1b827679dce899b010c0357214562016d11bb33ac4dd8c2e0439540fc9ec3b20: Status 404 returned error can't find the container with id 1b827679dce899b010c0357214562016d11bb33ac4dd8c2e0439540fc9ec3b20 Sep 10 02:45:01.383996 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:01.383957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" event={"ID":"3694818f-4824-42e5-a7fc-f38ce4704ce6","Type":"ContainerStarted","Data":"1b827679dce899b010c0357214562016d11bb33ac4dd8c2e0439540fc9ec3b20"} Sep 10 02:45:03.395674 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:03.395645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" event={"ID":"3694818f-4824-42e5-a7fc-f38ce4704ce6","Type":"ContainerStarted","Data":"81bd6d134c84532df931207fa92cd76693361bc2bb81a03cbc6d1a9d0d654988"} Sep 10 02:45:03.410446 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:03.410400 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" podStartSLOduration=1.039431669 podStartE2EDuration="3.410385744s" totalImagesPullingTime="2.370954075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:45:03.409795331 +0000 UTC m=+669.624780857" watchObservedRunningTime="2026-09-10 02:45:03.410385744 +0000 UTC m=+669.625371267" Sep 10 02:45:04.401146 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:04.401118 2559 generic.go:356] "Generic (PLEG): container finished" podID="3694818f-4824-42e5-a7fc-f38ce4704ce6" containerID="81bd6d134c84532df931207fa92cd76693361bc2bb81a03cbc6d1a9d0d654988" exitCode=0 Sep 10 02:45:04.401492 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:04.401203 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" event={"ID":"3694818f-4824-42e5-a7fc-f38ce4704ce6","Type":"ContainerDied","Data":"81bd6d134c84532df931207fa92cd76693361bc2bb81a03cbc6d1a9d0d654988"} Sep 10 02:45:05.527835 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:05.527810 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" Sep 10 02:45:06.410513 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:06.410484 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" Sep 10 02:45:06.410649 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:06.410512 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816805-rrztn" event={"ID":"3694818f-4824-42e5-a7fc-f38ce4704ce6","Type":"ContainerDied","Data":"1b827679dce899b010c0357214562016d11bb33ac4dd8c2e0439540fc9ec3b20"} Sep 10 02:45:06.410649 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:06.410548 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b827679dce899b010c0357214562016d11bb33ac4dd8c2e0439540fc9ec3b20" Sep 10 02:45:10.261215 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:10.261185 2559 scope.go:117] "RemoveContainer" containerID="09b21c52714e055b97dcb58d5fdf3ee96fd80f3715495dd15b1eff2583191158" Sep 10 02:45:10.261565 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:45:10.261347 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:45:22.260630 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:22.260588 2559 scope.go:117] "RemoveContainer" containerID="09b21c52714e055b97dcb58d5fdf3ee96fd80f3715495dd15b1eff2583191158" Sep 10 02:45:22.261083 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:45:22.260750 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:45:34.263522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:34.263209 2559 scope.go:117] "RemoveContainer" containerID="09b21c52714e055b97dcb58d5fdf3ee96fd80f3715495dd15b1eff2583191158" Sep 10 02:45:34.545880 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:34.545857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" event={"ID":"26f33b87-122b-41a6-b544-0b99cd53a7e4","Type":"ContainerStarted","Data":"e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1"} Sep 10 02:45:34.546196 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:34.546177 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:45:34.546340 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:45:34.546322 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:45:35.552606 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:35.552571 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f33b87-122b-41a6-b544-0b99cd53a7e4" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" exitCode=0 Sep 10 02:45:35.553048 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:35.552644 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" event={"ID":"26f33b87-122b-41a6-b544-0b99cd53a7e4","Type":"ContainerDied","Data":"e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1"} Sep 10 02:45:35.553048 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:35.552696 2559 scope.go:117] "RemoveContainer" containerID="09b21c52714e055b97dcb58d5fdf3ee96fd80f3715495dd15b1eff2583191158" Sep 10 02:45:35.553150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:35.553131 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:45:35.553314 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:45:35.553294 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:45:37.318202 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:37.318166 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:45:37.318202 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:37.318208 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:45:37.318751 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:37.318219 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:45:37.318751 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:37.318228 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:45:37.318751 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:37.318564 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:45:37.318751 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:45:37.318718 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:45:52.261108 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:45:52.261034 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:45:52.261464 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:45:52.261186 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:46:04.263557 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:04.263524 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:46:04.264031 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:46:04.263726 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:46:18.261229 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:18.261190 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:46:18.261691 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:46:18.261405 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:46:29.260977 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:29.260923 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:46:29.261377 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:46:29.261109 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:46:43.261131 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:43.261092 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:46:43.261514 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:46:43.261265 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:46:58.261205 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:58.261166 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:46:58.947744 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:58.947714 2559 generic.go:356] "Generic (PLEG): container finished" podID="26f33b87-122b-41a6-b544-0b99cd53a7e4" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" exitCode=0 Sep 10 02:46:58.947893 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:58.947747 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" event={"ID":"26f33b87-122b-41a6-b544-0b99cd53a7e4","Type":"ContainerDied","Data":"e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf"} Sep 10 02:46:58.947893 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:58.947779 2559 scope.go:117] "RemoveContainer" containerID="e9df600bd1e1aeacb9ee220d5cd4a99ec907ece1edac7b7d5e7a6f4952a03ad1" Sep 10 02:46:58.948181 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:46:58.948131 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:46:58.948315 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:46:58.948294 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:47:07.318589 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:07.318551 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:47:07.319028 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:07.318609 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:47:07.319028 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:07.318625 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:47:07.319028 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:07.318637 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" Sep 10 02:47:07.319028 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:07.319025 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:47:07.319251 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:47:07.319218 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:47:18.266222 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:18.266188 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:47:18.266676 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:47:18.266371 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:47:32.266347 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:32.266320 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:47:32.266792 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:47:32.266485 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:47:45.261150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:45.261120 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:47:45.261522 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:47:45.261284 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:47:58.261195 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:47:58.261147 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:47:58.261768 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:47:58.261399 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:48:10.261475 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:10.261437 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:48:10.261920 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:48:10.261595 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:48:20.347488 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:20.347460 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647784d6dd-8lpbr_e85a46e8-6f47-4781-a5a1-b38a6063c6fa/copy-manifests/0.log" Sep 10 02:48:20.353349 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:20.353325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647784d6dd-8lpbr_e85a46e8-6f47-4781-a5a1-b38a6063c6fa/manager/0.log" Sep 10 02:48:20.930946 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:20.930901 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816805-rrztn_3694818f-4824-42e5-a7fc-f38ce4704ce6/cleanup/0.log" Sep 10 02:48:22.218261 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:22.218235 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-rx6tv_39cef7a1-1c66-4d2d-8221-f1fd8b7581b3/kuadrant-console-plugin/0.log" Sep 10 02:48:22.260998 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:22.260973 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:48:22.261215 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:48:22.261189 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:48:22.346815 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:22.346794 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-7gg6j_67d056fc-d532-46d7-abbd-0255e13cac06/manager/0.log" Sep 10 02:48:22.462248 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:22.462227 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-qnmnz_13648fa6-73dc-425b-8473-595926c7dd2a/limitador/0.log" Sep 10 02:48:23.200091 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:23.200061 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74d6b6cf86-hgkhc_1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156/kube-auth-proxy/0.log" Sep 10 02:48:24.541440 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:24.541410 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-hlnw6_8681786f-c4d0-4a02-98ff-77eba7667ec3/main/0.log" Sep 10 02:48:24.892592 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:24.892570 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_26f33b87-122b-41a6-b544-0b99cd53a7e4/main/5.log" Sep 10 02:48:30.393716 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.393679 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m4dzq/must-gather-4dl8n"] Sep 10 02:48:30.394150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.394048 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3694818f-4824-42e5-a7fc-f38ce4704ce6" containerName="cleanup" Sep 10 02:48:30.394150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.394061 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3694818f-4824-42e5-a7fc-f38ce4704ce6" containerName="cleanup" Sep 10 02:48:30.394150 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.394120 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3694818f-4824-42e5-a7fc-f38ce4704ce6" containerName="cleanup" Sep 10 02:48:30.396894 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.396877 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4dzq/must-gather-4dl8n" Sep 10 02:48:30.399294 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.399267 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m4dzq\"/\"kube-root-ca.crt\"" Sep 10 02:48:30.399831 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.399816 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m4dzq\"/\"openshift-service-ca.crt\"" Sep 10 02:48:30.406053 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.406031 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4dzq/must-gather-4dl8n"] Sep 10 02:48:30.549879 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.549852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3c7cee1-1777-4ef8-893d-eece3d1714b6-must-gather-output\") pod \"must-gather-4dl8n\" (UID: \"a3c7cee1-1777-4ef8-893d-eece3d1714b6\") " pod="openshift-must-gather-m4dzq/must-gather-4dl8n" Sep 10 02:48:30.550030 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.549882 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdz9l\" (UniqueName: \"kubernetes.io/projected/a3c7cee1-1777-4ef8-893d-eece3d1714b6-kube-api-access-jdz9l\") pod \"must-gather-4dl8n\" (UID: \"a3c7cee1-1777-4ef8-893d-eece3d1714b6\") " pod="openshift-must-gather-m4dzq/must-gather-4dl8n" Sep 10 02:48:30.651180 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.651127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3c7cee1-1777-4ef8-893d-eece3d1714b6-must-gather-output\") pod \"must-gather-4dl8n\" (UID: \"a3c7cee1-1777-4ef8-893d-eece3d1714b6\") " pod="openshift-must-gather-m4dzq/must-gather-4dl8n" Sep 10 02:48:30.651180 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.651156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdz9l\" (UniqueName: \"kubernetes.io/projected/a3c7cee1-1777-4ef8-893d-eece3d1714b6-kube-api-access-jdz9l\") pod \"must-gather-4dl8n\" (UID: \"a3c7cee1-1777-4ef8-893d-eece3d1714b6\") " pod="openshift-must-gather-m4dzq/must-gather-4dl8n" Sep 10 02:48:30.651497 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.651480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a3c7cee1-1777-4ef8-893d-eece3d1714b6-must-gather-output\") pod \"must-gather-4dl8n\" (UID: \"a3c7cee1-1777-4ef8-893d-eece3d1714b6\") " pod="openshift-must-gather-m4dzq/must-gather-4dl8n" Sep 10 02:48:30.660674 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.660648 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdz9l\" (UniqueName: \"kubernetes.io/projected/a3c7cee1-1777-4ef8-893d-eece3d1714b6-kube-api-access-jdz9l\") pod \"must-gather-4dl8n\" (UID: \"a3c7cee1-1777-4ef8-893d-eece3d1714b6\") " pod="openshift-must-gather-m4dzq/must-gather-4dl8n" Sep 10 02:48:30.706843 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.706823 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4dzq/must-gather-4dl8n" Sep 10 02:48:30.994261 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:30.990277 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4dzq/must-gather-4dl8n"] Sep 10 02:48:31.375039 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:31.374998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dzq/must-gather-4dl8n" event={"ID":"a3c7cee1-1777-4ef8-893d-eece3d1714b6","Type":"ContainerStarted","Data":"945d72392dbb4569d83a98ae2e770e085db3db6b9bdfaf2e0ebe51be0fafa0dd"} Sep 10 02:48:32.385369 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:32.385189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dzq/must-gather-4dl8n" event={"ID":"a3c7cee1-1777-4ef8-893d-eece3d1714b6","Type":"ContainerStarted","Data":"9a63e2764784232c48780a3dfc0a14d488fdae511e2fc372574284704b093480"} Sep 10 02:48:32.385369 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:32.385251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dzq/must-gather-4dl8n" event={"ID":"a3c7cee1-1777-4ef8-893d-eece3d1714b6","Type":"ContainerStarted","Data":"beb9d57681bc685c83a1271b5dc20aab82b366ab8c45f128d732bd2706eb5006"} Sep 10 02:48:33.261043 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:33.261007 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:48:33.261243 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:48:33.261220 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:48:33.614304 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:33.614277 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tglws_7b1b6871-29ad-4c86-8d5e-ad9470704f9e/global-pull-secret-syncer/0.log" Sep 10 02:48:33.694496 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:33.694465 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kf6nh_001505d9-7034-4917-9d20-1617b28991e7/konnectivity-agent/0.log" Sep 10 02:48:33.799728 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:33.799702 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-27.ec2.internal_43c6e8f9bb9c38ea54330318f6fcad24/haproxy/0.log" Sep 10 02:48:38.146646 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:38.146607 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-rx6tv_39cef7a1-1c66-4d2d-8221-f1fd8b7581b3/kuadrant-console-plugin/0.log" Sep 10 02:48:38.188762 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:38.188663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-7gg6j_67d056fc-d532-46d7-abbd-0255e13cac06/manager/0.log" Sep 10 02:48:38.212569 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:38.212518 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-qnmnz_13648fa6-73dc-425b-8473-595926c7dd2a/limitador/0.log" Sep 10 02:48:39.858818 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:39.858716 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-w9fr2_cfce1a77-e7d9-465e-a581-c9f0538b4335/kube-state-metrics/0.log" Sep 10 02:48:39.875943 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:39.875895 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-w9fr2_cfce1a77-e7d9-465e-a581-c9f0538b4335/kube-rbac-proxy-main/0.log" Sep 10 02:48:39.896834 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:39.896770 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-w9fr2_cfce1a77-e7d9-465e-a581-c9f0538b4335/kube-rbac-proxy-self/0.log" Sep 10 02:48:39.983300 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:39.983267 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8k7fw_c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2/node-exporter/0.log" Sep 10 02:48:40.004548 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.004502 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8k7fw_c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2/kube-rbac-proxy/0.log" Sep 10 02:48:40.027875 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.027845 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8k7fw_c704b0b6-d96d-46e9-8a5b-a51c8c8d8bb2/init-textfile/0.log" Sep 10 02:48:40.220283 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.220255 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-5dcpn_766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41/kube-rbac-proxy-main/0.log" Sep 10 02:48:40.241899 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.241839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-5dcpn_766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41/kube-rbac-proxy-self/0.log" Sep 10 02:48:40.273544 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.273464 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-5dcpn_766fac2b-a5dd-4fb4-a9ca-654dcdd9bb41/openshift-state-metrics/0.log" Sep 10 02:48:40.312623 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.312588 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73980114-ba3f-469b-a4e1-e201802346d1/prometheus/0.log" Sep 10 02:48:40.338480 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.338448 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73980114-ba3f-469b-a4e1-e201802346d1/config-reloader/0.log" Sep 10 02:48:40.364380 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.364354 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73980114-ba3f-469b-a4e1-e201802346d1/thanos-sidecar/0.log" Sep 10 02:48:40.388727 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.388683 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73980114-ba3f-469b-a4e1-e201802346d1/kube-rbac-proxy-web/0.log" Sep 10 02:48:40.415331 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.415289 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73980114-ba3f-469b-a4e1-e201802346d1/kube-rbac-proxy/0.log" Sep 10 02:48:40.461951 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.458790 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73980114-ba3f-469b-a4e1-e201802346d1/kube-rbac-proxy-thanos/0.log" Sep 10 02:48:40.491998 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.491595 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_73980114-ba3f-469b-a4e1-e201802346d1/init-config-reloader/0.log" Sep 10 02:48:40.526948 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.523710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-rqt4r_848eff4a-2d61-406b-8811-9809f6a4f6e6/prometheus-operator/0.log" Sep 10 02:48:40.546953 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.546569 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-rqt4r_848eff4a-2d61-406b-8811-9809f6a4f6e6/kube-rbac-proxy/0.log" Sep 10 02:48:40.577339 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.577306 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-lg95n_523369b4-d018-4d3a-b0eb-c52d6a95f33e/prometheus-operator-admission-webhook/0.log" Sep 10 02:48:40.737954 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.737891 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/thanos-query/0.log" Sep 10 02:48:40.771059 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.771030 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/kube-rbac-proxy-web/0.log" Sep 10 02:48:40.798969 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.798944 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/kube-rbac-proxy/0.log" Sep 10 02:48:40.822223 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.822200 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/prom-label-proxy/0.log" Sep 10 02:48:40.847304 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.847275 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/kube-rbac-proxy-rules/0.log" Sep 10 02:48:40.869511 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:40.869477 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cfccb5847-7vfkd_4d6368fd-0d84-456e-b52f-40d48156272c/kube-rbac-proxy-metrics/0.log" Sep 10 02:48:43.715838 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:43.715802 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-7ppbf_b0fe8b34-491b-48f7-8a08-297cda1a0d23/download-server/0.log" Sep 10 02:48:43.958900 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:43.958836 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m4dzq/must-gather-4dl8n" podStartSLOduration=12.985669508 podStartE2EDuration="13.958813915s" totalImagesPullingTime="973.144407ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 02:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:48:32.402719645 +0000 UTC m=+878.617705167" watchObservedRunningTime="2026-09-10 02:48:43.958813915 +0000 UTC m=+890.173799441" Sep 10 02:48:43.960323 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:43.960294 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr"] Sep 10 02:48:43.968665 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:43.968601 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:43.971300 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:43.971275 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m4dzq\"/\"default-dockercfg-9mkwm\"" Sep 10 02:48:43.975819 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:43.975799 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr"] Sep 10 02:48:44.094791 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.094756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-proc\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.094958 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.094847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h48lg\" (UniqueName: \"kubernetes.io/projected/5a122486-a7fe-471a-a0ff-4758ac1153df-kube-api-access-h48lg\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.094958 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.094890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-podres\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.095087 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.094979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-lib-modules\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.095087 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.095006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-sys\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196069 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-proc\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196251 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196104 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h48lg\" (UniqueName: \"kubernetes.io/projected/5a122486-a7fe-471a-a0ff-4758ac1153df-kube-api-access-h48lg\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196251 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-podres\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196251 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196167 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-proc\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196251 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-lib-modules\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196251 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-sys\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196332 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-podres\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196346 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-lib-modules\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.196522 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.196393 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a122486-a7fe-471a-a0ff-4758ac1153df-sys\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.205261 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.205238 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h48lg\" (UniqueName: \"kubernetes.io/projected/5a122486-a7fe-471a-a0ff-4758ac1153df-kube-api-access-h48lg\") pod \"perf-node-gather-daemonset-bq6dr\" (UID: \"5a122486-a7fe-471a-a0ff-4758ac1153df\") " pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.306056 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.305992 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:44.594277 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:44.594198 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr"] Sep 10 02:48:45.508499 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:45.508422 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" event={"ID":"5a122486-a7fe-471a-a0ff-4758ac1153df","Type":"ContainerStarted","Data":"ff8b2fe828c08fc2596f52944f032b0c312ad78e51d40653b57fb9bd4097c0f8"} Sep 10 02:48:45.508842 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:45.508519 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:45.508842 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:45.508537 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" event={"ID":"5a122486-a7fe-471a-a0ff-4758ac1153df","Type":"ContainerStarted","Data":"cbd63b7a247843cb2abfdd987631d77a3e613b08d14eb047b00104c323e1d85b"} Sep 10 02:48:45.526531 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:45.526471 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" podStartSLOduration=2.5264522659999997 podStartE2EDuration="2.526452266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 02:48:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 02:48:45.524876613 +0000 UTC m=+891.739862141" watchObservedRunningTime="2026-09-10 02:48:45.526452266 +0000 UTC m=+891.741437790" Sep 10 02:48:45.553945 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:45.553900 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bnskt_cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279/dns/0.log" Sep 10 02:48:45.575584 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:45.575562 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bnskt_cdf3aa85-eb4d-4c7f-b5ec-0ec89eff9279/kube-rbac-proxy/0.log" Sep 10 02:48:45.697078 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:45.697054 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gr2bh_55c21cc0-e3c4-4397-aebe-73777fd14832/dns-node-resolver/0.log" Sep 10 02:48:46.272729 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:46.272690 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dskqq_9bded73a-92e1-45bf-81b3-8614cf134d27/node-ca/0.log" Sep 10 02:48:47.261785 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:47.261742 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:48:47.262305 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:48:47.261966 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:48:47.337502 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:47.337471 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74d6b6cf86-hgkhc_1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156/kube-auth-proxy/0.log" Sep 10 02:48:48.075021 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:48.074995 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-chsmv_3723a4ec-174f-496b-8935-5c280e4796d9/serve-healthcheck-canary/0.log" Sep 10 02:48:48.681066 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:48.681037 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8lqg_99209777-b12f-42f4-92d7-07c926cc1725/kube-rbac-proxy/0.log" Sep 10 02:48:48.703721 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:48.703692 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8lqg_99209777-b12f-42f4-92d7-07c926cc1725/exporter/0.log" Sep 10 02:48:48.726152 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:48.726130 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n8lqg_99209777-b12f-42f4-92d7-07c926cc1725/extractor/0.log" Sep 10 02:48:51.099261 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:51.099226 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647784d6dd-8lpbr_e85a46e8-6f47-4781-a5a1-b38a6063c6fa/manager/0.log" Sep 10 02:48:51.119660 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:51.119626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647784d6dd-8lpbr_e85a46e8-6f47-4781-a5a1-b38a6063c6fa/copy-manifests/0.log" Sep 10 02:48:51.531318 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:51.530635 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m4dzq/perf-node-gather-daemonset-bq6dr" Sep 10 02:48:52.342763 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:52.342737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-748c765c7f-tdhmh_be6a77e8-8f47-46dc-b162-4457a6227f61/manager/0.log" Sep 10 02:48:52.365979 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:52.365950 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-695vp_0d3cb986-1ebc-4ac6-bcd7-c8e664154a5d/openshift-lws-operator/0.log" Sep 10 02:48:54.082814 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:54.082721 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74d6b6cf86-hgkhc_1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156/kube-auth-proxy/0.log" Sep 10 02:48:55.295363 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:55.295333 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74d6b6cf86-hgkhc_1c4d3f8c-4fd1-4eb3-9d2a-4d8462718156/kube-auth-proxy/0.log" Sep 10 02:48:59.607485 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.607456 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltlr4_a0784fe7-0641-4c4f-b6c8-b82c0f1ab538/kube-multus-additional-cni-plugins/0.log" Sep 10 02:48:59.628727 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.628705 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltlr4_a0784fe7-0641-4c4f-b6c8-b82c0f1ab538/egress-router-binary-copy/0.log" Sep 10 02:48:59.649349 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.649328 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltlr4_a0784fe7-0641-4c4f-b6c8-b82c0f1ab538/cni-plugins/0.log" Sep 10 02:48:59.671642 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.671614 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltlr4_a0784fe7-0641-4c4f-b6c8-b82c0f1ab538/bond-cni-plugin/0.log" Sep 10 02:48:59.691771 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.691746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltlr4_a0784fe7-0641-4c4f-b6c8-b82c0f1ab538/routeoverride-cni/0.log" Sep 10 02:48:59.714057 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.714038 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltlr4_a0784fe7-0641-4c4f-b6c8-b82c0f1ab538/whereabouts-cni-bincopy/0.log" Sep 10 02:48:59.737879 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.737860 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltlr4_a0784fe7-0641-4c4f-b6c8-b82c0f1ab538/whereabouts-cni/0.log" Sep 10 02:48:59.798635 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.798607 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-psvlk_edcf4db9-ad51-432f-a6a2-bf4704eefc09/kube-multus/0.log" Sep 10 02:48:59.918954 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.918915 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fsnp7_054304ea-1c6d-48fc-aaa8-8339373832c9/network-metrics-daemon/0.log" Sep 10 02:48:59.938512 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:48:59.938487 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fsnp7_054304ea-1c6d-48fc-aaa8-8339373832c9/kube-rbac-proxy/0.log" Sep 10 02:49:00.261591 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:00.261511 2559 scope.go:117] "RemoveContainer" containerID="e64c849c3f42b81fa03d419ae335842b169c26d5fbfdeacff617b79da0d4aaaf" Sep 10 02:49:00.262173 ip-10-0-143-27 kubenswrapper[2559]: E0910 02:49:00.261742 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd_llm(26f33b87-122b-41a6-b544-0b99cd53a7e4)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-qxdmd" podUID="26f33b87-122b-41a6-b544-0b99cd53a7e4" Sep 10 02:49:00.929143 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:00.929118 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcwss_f14bce2e-23e5-48b2-b1e1-a3dd87b3652a/ovn-controller/0.log" Sep 10 02:49:00.945740 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:00.945716 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcwss_f14bce2e-23e5-48b2-b1e1-a3dd87b3652a/ovn-acl-logging/0.log" Sep 10 02:49:00.970154 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:00.970128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcwss_f14bce2e-23e5-48b2-b1e1-a3dd87b3652a/kube-rbac-proxy-node/0.log" Sep 10 02:49:00.989671 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:00.989650 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcwss_f14bce2e-23e5-48b2-b1e1-a3dd87b3652a/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 02:49:01.008656 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:01.008636 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcwss_f14bce2e-23e5-48b2-b1e1-a3dd87b3652a/northd/0.log" Sep 10 02:49:01.027265 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:01.027244 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcwss_f14bce2e-23e5-48b2-b1e1-a3dd87b3652a/nbdb/0.log" Sep 10 02:49:01.045678 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:01.045663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcwss_f14bce2e-23e5-48b2-b1e1-a3dd87b3652a/sbdb/0.log" Sep 10 02:49:01.084382 ip-10-0-143-27 kubenswrapper[2559]: I0910 02:49:01.084357 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcwss_f14bce2e-23e5-48b2-b1e1-a3dd87b3652a/ovnkube-controller/0.log"